Image processing device, method, and storage medium which stores a program

ABSTRACT

An image processing device including an image processing section having: one or more image processing modules, each image processing module having an image processing engine and a control section; and one or more buffer modules having a buffer for storing image data. The image processing module is realized by a program, which corresponds to the image processing engine, and a program, which corresponds to the control section, being executed by a CPU of the image processing device, and a portion of or an entirety of the program corresponding to the control section is used in common for, among the plurality of types of image processing modules, image processing modules whose units of writing image data to the buffer of the buffer module connected at the following stage of its own module are the same.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority under 35 USC 119 from Japanese PatentApplication No. 2005-164189, the disclosure of which is incorporated byreference herein.

BACKGROUND

1. Technical Field

The present invention relates to an image processing device, method, anda storage medium which stores a program, and in particular, to an imageprocessing device equipped with an image processing section which isconstructed to include one or more image processing modules selectedfrom among plural types of image processing modules, and to an imageprocessing method which can be applied to the image processing device,and to a storage medium which stores an image processing program formaking a computer function as the image processing device.

2. Related Art

Various types of image processings, such as enlargement/reduction,rotation, affine transformation, color conversion, filtering processing,image composing are carried out on inputted image data at an imageprocessing device, a DTP (desktop publishing) system, a printing systemand the like. In such devices and systems, when the attributes ofinputted image data or the contents, procedures, parameters and the likeare fixed, the image processings are carried out by hardware which isdesigned for exclusive use therefor. However, when the attributes arechanged variously or when various image data which have different colorspace or different numbers of bits per pixel are inputted as theinputted image data, a structure of the image processings needs to bechanged flexibly. In order to satisfy such a demand, there are sometechniques in which programmable processing modules are connected in apipeline form or a DAG (directed acyclic graph) form.

However, there are the following problems. At each of the imageprocessing modules, there is a unit which is easy to process inaccordance with the type and the contents of the image processing (e.g.,a unit of a pixel, a unit of one line, a unit of plural lines, a unit ofone whole image, or the like). In order to combine the respective imageprocessing modules in an arbitrary order and carry out processings incooperation with one another, the units of output of all of the imageprocessing modules must be made to be uniform, or each of the imageprocessing modules must be structured. Therefore, the structures of theimage processing modules become complex. Further, since each of theimage processing modules operates in concert with other image processingmodules, each image processing module needs a section which controls theprocessings of receipt and transfer of image data to and from the otherimage processing modules which are connected to its own module inaddition to a section which actually carries out image processing on theinputted image data. Therefore, the structure of each image processingmodule becomes even more complex.

Moreover, each buffer memory is structured to hold a regioncorresponding to the processing contents of the image processing modulesconnected therebefore and thereafter, and merely functions only to holdthe midway progress of the processings. Therefore, when a given imageprocessing module is changed, the capacities need to be changed inaccordance with the processing contents of that image processing moduleand the processing contents of the image processing modules which arebefore and after the buffer memories or the like.

SUMMARY OF THE INVENTION

In order to achieve the above-described object, a first inventionprovides an image processing device comprising: an image processingsection, the image processing section having: (A) one or more imageprocessing modules, each image processing module having: (1) an imageprocessing engine carrying out a predetermined image processing on imagedata in units of a unit processing data amount which is set in advance,and (2) a control section inputting image data, which is acquired from apreceding stage of its own module, in data amount units needed in orderfor the image processing engine to carry out processing in units of theunit processing data amount, and outputting, to a following stage of itsown module, image data, which has undergone a predetermined imageprocessing by the image processing engine, or processing results of thepredetermined image processing, the one or more image processing modulesbeing selected from a plurality of types of image processing modules atwhich types or contents of image processings carried out by the imageprocessing engines are different from one another; and (B) one or morebuffer modules having a buffer for storing image data, the imageprocessing section being constructed by individual modules beingconnected in a pipeline form or a directed acyclic graph form, such thatthe buffer module is connected at at least one of a preceding stage anda following stage of each image processing module which is selected,wherein the control section of the image processing module, in a case inwhich the buffer module is connected at a following stage of its ownmodule, carries out processing of writing, in units of a write dataamount which is set in advance at the following buffer module, imagedata, which is obtained by the image processing engine carrying out thepredetermined image processing on inputted image data, to the buffer ofthe following buffer module, and the image processing module is realizedby a program, which corresponds to the image processing engine, and aprogram, which corresponds to the control section, being executed by aCPU of the image processing device, and a portion of or an entirety ofthe program corresponding to the control section is used in common for,among the plurality of types of image processing modules, imageprocessing modules whose units of writing image data to the buffer ofthe buffer module connected at the following stage of its own module arethe same.

The image processing module relating to the first invention has an imageprocessing engine and a control section. The image processing enginecarries out a predetermined image processing on image data in units of aunit processing data amount which is set in advance. The control sectioninputs image data, which is acquired from a preceding stage of its ownmodule, in data amount units needed in order for the image processingengine to carry out processing in units of the unit processing dataamount, and outputs, to a following stage of its own module, image data,which has undergone a predetermined image processing by the imageprocessing engine, or processing results of the predetermined imageprocessing. In the first invention, plural types of image processingmodules, at which the types or the contents of the image processingscarried out by the image processing engines are different from oneanother, are readied. One or more image processing modules are selectedfrom the plural types of image processing modules. The image processingsection is constructed by individual modules being connected in apipeline form or a directed acyclic graph form, such that the one ormore buffer modules, which have a buffer for storing image data, areconnected at at least one of a preceding stage and a following stage ofeach image processing module which is selected. Note that the imageprocessing modules, which are selected in order to construct the imageprocessing section, may be image processing modules which arerespectively different, or may be selected such that portions orentireties of the image processing modules overlap one another.

The control section of the image processing module relating to the firstinvention is structured so as to, in a case in which the buffer moduleis connected at the following stage of its own module, carry out theprocessing of writing, in units of a write data amount which is set inadvance at the following buffer module, image data, which is obtained bythe image processing engine carrying out the predetermined imageprocessing on inputted image data, to the buffer of the following buffermodule. Further, the image processing module is realized by a program,which corresponds to the image processing engine, and a program, whichcorresponds to the control section, being executed by a CPU of the imageprocessing device. A portion of or the entirety of the programcorresponding to the control section is used in common for, among theplural types of image processing modules, those image processing moduleswhose units of writing image data to the buffer of the buffer moduleconnected at the following stage of its own module are the same.

In this way, in the first invention, an image processing module, atwhich a buffer module is connected at the following stage thereof,writes image data, in units of the write data amount which is set inadvance, to the buffer of the following buffer module. Therefore, theimage processing module, at which a buffer module is connected at thefollowing stage thereof, does not need to make the unit of output of theimage data be in line with a reference value which is fixedlydetermined. Accordingly, the unit processing data amount, at the imageprocessing engine of each image processing module, can be optimized inaccordance with the type or the like of the image processing which theimage processing engine carries out, and it is possible to realizeoptimization (increased speed, improved image quality, and the like) ofthe image processings which the image processing engines of theindividual image processing modules carry out. Accordingly, it ispossible to combine arbitrary image processing modules and have desiredimage processings be carried out, without leading to the structures ofthe individual image processing modules becoming complex.

Moreover, in the first invention, a portion of or the entirety of theprogram corresponding to the control section is used in common for,among the plural types of image processing modules, the image processingmodules whose units of writing image data to the buffer of the buffermodule connected at the following stage of its own module are the same.Therefore, the burden of development in developing the programscorresponding to the control sections of the image processing modules isreduced, and costs required in developing the image processing modulescan be reduced.

A second invention provides an image processing device comprising: animage processing section, the image processing section having: (A) oneor more image processing modules, each image processing module having:(1) an image processing engine carrying out a predetermined imageprocessing on image data in units of a unit processing data amount whichis set in advance, and (2) a control section inputting image data, whichis acquired from a preceding stage of its own module, in data amountunits needed in order for the image processing engine to carry-outprocessing in units of the unit processing data amount, and outputting,to a following stage of its own module, image data, which has undergonea predetermined image processing by the image processing engine, orprocessing results of the predetermined image processing, the one ormore image processing modules being selected from a plurality of typesof image processing modules at which types or contents of imageprocessings carried out by the image processing engines are differentfrom one another; and (B) one or more buffer modules having a buffer forstoring image data, the image processing section being constructed byindividual modules being connected in a pipeline form or a directedacyclic graph form, such that the buffer module is connected at at leastone of a preceding stage and a following stage of each image processingmodule which is selected, wherein the control section of the imageprocessing module, in a case in which the buffer module is connected ata preceding stage of its own module, carries out processings of reading,in units of a read data amount which is set in advance at the precedingbuffer module, image data which is stored in the buffer of the precedingbuffer module, and inputting the read image data to the image processingengine as image data of the unit processing data amount, and the imageprocessing module is realized by a program, which corresponds to theimage processing engine, and a program, which corresponds to the controlsection, being executed by a CPU of the image processing device, and aportion of or an entirety of the program corresponding to the controlsection is used in common for, among the plurality of types of imageprocessing modules, image processing modules whose units of readingimage data from the buffer of the buffer module connected at thepreceding stage of its own module are the same.

The control section of the image processing module relating to thesecond invention is structured so as to, in a case in which the buffermodule is connected at a preceding stage of its own module, carry outprocessings of reading, in units of a read data amount which is set inadvance at the preceding buffer module, image data, which is stored inthe buffer of the preceding buffer module, and inputting the read imagedata to the image processing engine as image data of the unit processingdata amount. Further, the image processing module is realized by aprogram, which corresponds to the image processing engine, and aprogram, which corresponds to the control section, being executed by aCPU of the image processing device. A portion of or the entirety of theprogram corresponding to the control section is used in common for,among the plural types of image processing modules, those imageprocessing modules whose units of reading image data from the buffer ofthe buffer module connected at the preceding stage of its own module arethe same.

In this way, in the second invention, an image processing module, atwhich a buffer module is connected at the preceding stage thereof,reads, in units of the read data amount which is set in advance, theimage data stored in the buffer of the preceding buffer module, andinputs the read image data to the image processing engine as image dataof the unit processing data amount. Therefore, the image processingmodule, at which a buffer module is connected at the preceding stagethereof, does not need to make the unit of reading of the image data bein line with a reference value which is fixedly determined. Accordingly,the unit processing data amount, at the image processing engine of eachimage processing module, can be optimized in accordance with the type orthe like of the image processing which the image processing enginecarries out, and it is possible to realize optimization (increasedspeed, improved image quality, and the like) of the image processingswhich the image processing engines of the individual image processingmodules carry out. Accordingly, it is possible to combine arbitraryimage processing modules and have desired image processings be carriedout, without leading to the structures of the individual imageprocessing modules becoming complex.

Moreover, in the second invention, a portion of or the entirety of theprogram corresponding to the control section is used in common for,among the plural types of image processing modules, the image processingmodules whose units of reading image data from the buffer of the buffermodule connected at the preceding stage of its own module are the same.Therefore, the burden of development in developing the programscorresponding to the control sections of the image processing modules isreduced, and costs required in developing the image processing modulescan be reduced.

BRIEF DESCRIPTION OF THE DRAWINGS

An embodiment of the present invention will be described in detail basedon the following figures, wherein:

FIG. 1 is a block diagram showing the schematic structure of a computer(image processing device) relating to the embodiment;

FIG. 2A is a flowchart showing the contents of initializing processingwhich is executed by a resource managing section;

FIG. 2B is a flowchart showing the contents of processing for a memoryreserving request in a third managing method, which is executed by theresource managing section;

FIG. 2C is a flowchart showing the contents of processing for a memoryfreeing request in the third managing method, which is executed by theresource managing section;

FIG. 2D is a flowchart showing the contents of processing for a resourcereserving request, which is executed by the resource managing section;

FIG. 2E is a flowchart showing the contents of processing for a resourcefreeing request, which is executed by the resource managing section;

FIG. 3 is a sequence diagram for explaining processings by anapplication;

FIG. 4A is a flowchart showing the contents of module generatingprocessing executed by a module generating section, and FIG. 4B is aschematic diagram explaining a table of a workflow managing section;

FIGS. 5A to 5C are block diagrams showing structural examples of animage processing section;

FIG. 6 is a flowchart showing the contents of buffer control processingexecuted by a buffer control section of a buffer module;

FIG. 7 is a flowchart showing the contents of request receptioninterruption processing executed by the buffer control section of thebuffer module;

FIG. 8 is a flowchart showing the contents of data writing processingexecuted by the buffer control section of the buffer module;

FIGS. 9A to 9C are schematic diagrams explaining processings in a casein which image data which is the object of writing extends over pluralunit buffer regions for storage;

FIG. 10 is a flowchart showing the contents of data reading processingexecuted by the buffer control section of the buffer module;

FIGS. 11A to 11C are schematic diagrams explaining processings in a casein which image data which is the object of reading extends over pluralunit buffer regions for storage;

FIG. 12 is a flowchart showing the contents of image processing moduleinitializing processing executed by a control section of an imageprocessing module;

FIG. 13 is a flowchart showing the contents of image processing modulecontrol processing executed by the control section of the imageprocessing module;

FIG. 14 is a flowchart showing the contents of self-module deletingprocessing executed by the control section of the image processingmodule;

FIG. 15A is a block diagram showing the schematic structure of andprocessings executed at the image processing module, and FIG. 15B is ablock diagram showing the schematic structure of and processingsexecuted at the buffer module;

FIGS. 16A to 16D are flowcharts showing the contents of block unitcontrol processing executed by a processing managing section;

FIGS. 17A to 17D are flowcharts showing the contents of whole imagecontrol processing executed by the processing managing section;

FIG. 18 is a schematic diagram explaining the flow of the block unitprocessing and the whole image processing;

FIG. 19 is a flowchart showing the contents of error occurrenceinterruption processing executed by the processing managing section; and

FIG. 20 is a schematic diagram explaining the flow of the block unitprocessing in an aspect in which the buffer module directly requestsimage data from the preceding image processing module.

DETAILED DESCRIPTION

Hereinafter, an example of an embodiment of the present invention willbe described in detail with reference to the drawings. FIG. 1 shows acomputer 10 as an image processing device. This computer 10 may beincorporated into an arbitrary image handling device which must carryout image processings at the interior thereof, such as a copier, aprinter, a fax machine, a multifunction device which has the functionsof the aforementioned devices, a scanner, a photographing printer, orthe like. Also, the computer 10 may be an independent computer such as apersonal computer (PC) or the like. Further, the computer 10 may be acomputer which is incorporated into a portable device, such as a PDA(personal digital assistant), a cellular phone, or the like.

The computer 10 has a CPU 12, a memory 14, a display 16, an operationsection 18, a storage 20, an image data supplying section 22, and animage outputting section 24, and these are connected together via a bus26. In a case in which the computer 10 is incorporated into an imagehandling device such those mentioned above, the computer 10 may include,as the display 16 and the operation section 18, a display panel formedfrom an LCD or the like, a ten key, or the like which are respectivelyprovided at the image handling device. Further, if the computer 10 is anindependent computer, the display 16 may be a display and the operationsection 18 may be a keyboard, a mouse, or the like, which are connectedto the computer. Moreover, an HDD (hard disk drive) is suitable as thestorage 20, but instead, another non-volatile storage medium, such as aflash memory or the like, may be used.

The image data supplying section 22 supplies image data which is theobject of processing. For example, an image reading section, which readsan image recorded on a recording material such as paper or aphotographic film or the like and outputs image data, or a receivingsection which receives image data from the exterior via a communicationline, or an image storage section (the memory 14 or the storage 20)which stores image data, or the like, can be used as the image datasupplying section 22. Further, the image outputting section 24 outputsimage data which has undergone image processings, or an image expressedby such image data. For example, an image recording section whichrecords an image expressed by image data onto a recording material suchas paper or a photosensitive material or the like, or a display sectionwhich displays an image expressed by image data on a display or thelike, or a writing device which writes image data to a recording medium,or a transmitting section which transmits image data via a communicationline, may be used as the image outputting section 24. Further, the imageoutputting section 24 may be an image storage section (the memory 14 orthe storage 20) which merely stores image data which has undergone imageprocessings.

As shown in FIG. 1, the storage 20 stores, as various types of programswhich are executed by the CPU 12, a program of an operating system 30which governs the management of resources such as the memory 14 or thelike, the management of the execution of programs by the CPU 12, thecommunication between the computer 10 and the exterior, and the like; animage processing program group 34 which makes the computer 10 functionas the image processing device relating to the present invention; andprograms (shown as “application program group 32” in FIG. 1) of varioustypes of applications 32 which cause the image processing device, whichis realized by the CPU 12 executing the aforementioned image processingprogram group, to carry out desired image processings.

The image processing program group 34 is programs which are developed soas to be able to be used in common at various types of image handlingdevices and various devices (platforms) such as portable devices, PCs,and the like, for the purpose of reducing the burden of development fordeveloping image processing programs which can be used in theaforementioned various types of image handling devices and portabledevices, PCs, and the like. The image processing program group 34corresponds to the image processing program relating to the presentinvention. The image processing device which is realized by the imageprocessing program group 34 constructs an image processing section whichcarries out the image processing(s) and carries out image processing(s)by the image processing section (details will be described later) basedon instructions from the application 32. The image processing programgroup 34 provides the application 32 with an interface for instructingthe construction of an image processing section, and for instructingexecution of image processing(s) by the constructed image processingsection. Therefore, when an arbitrary device which carries out imageprocessing(s) at the interior is newly developed or the like, a programwhich carries out the image processing(s) can be obtained by merelydeveloping the application 32. The application 32 causes the imageprocessing program group 34 to carry out the image processing(s) neededat that device by using the interface. Since there is no longer the needto newly develop a program which actually carries out the imageprocessing(s), the burden of development can be lessened.

As mentioned above, the image processing device which is realized by theimage processing program group 34 constructs an image processing sectionwhich carries out the image processing(s) instructed by the application32, and carries out the image processing(s) by the constructed imageprocessing section. Therefore, even in a case in which, for example, thecolor space or the number of bits per pixel of the image data which isthe object of image processing is unfixed, or the contents, theprocedures, the parameters are unfixed due to the application 32instructing the reconstruction of the image processing section. Theimage processing(s) executed by the image processing device (the imageprocessing section) can be flexibly changed in accordance with theprocessed image data or the like.

The image processing program group 34 will be described hereinafter. Asshown in FIG. 1, the image processing program group 34 is broadlydivided into a module library 36, programs of a processing constructingsection 42 corresponding to the constructing section, and programs of aprocessing managing section 46. The processing constructing section 42constructs an image processing section 50 based on an instruction fromthe application. As shown in FIG. 5, the image processing section 50 isformed by one or more image processing modules 38 and buffer modules 40.They are connected together in a pipeline form or a DAG (directedacyclic graph) form. The image processing modules 38 carry out imageprocessings. The buffer modules 40 store image data and they aredisposed at at least one of the preceding and the following stages ofthe individual image processing modules 38.

Each image processing module itself structuring the image processingsection 50 is a first program which is executed by the CPU 12 and whichis for causing a predetermined image processing to be carried out at theCPU 12, or a second program which is executed by the CPU 12 and which isfor instructing the execution of processing with respect to an externalimage processing device which is not illustrated in FIG. 1 (e.g., adedicated image processing board or the like). The programs of theplural types of the image processing modules 38, which carry outrespectively different image processings (e.g., input processing,filtering processing, color converting processing, enlargement/reductionprocessing, skew angle sensing processing, image rotating processing,image composing processing, output processing, and the like), arerespectively registered in the module library 36. Hereinafter, in orderto simplify explanation, description will be given with each of theindividual image processing modules themselves structuring the imageprocessing section 50 being the aforementioned first program.

As shown in FIG. 15A, each of the image processing modules 38 isstructured from an image processing engine 38A and a control section38B. The image processing engine 38A carries out the image processing onthe image data, per a predetermined unit processing data amount. Thecontrol section 38B carries out input and output of image data with themodules at the preceding and the following stages of the imageprocessing module 38, and controls the image processing engine 38A. Theunit processing data amount at each of the image processing modules 38is selected and set in advance in accordance with the type of the imageprocessing which the image processing engine 38A carries out or thelike, from among an arbitrary number of bytes such as one line of animage, plural lines of an image, one pixel of an image, one image (awhole image), or the like. For example, at the image processing modules38 which carry out color converting processing and filtering processing,the unit processing data amount is one pixel. At the image processingmodule 38 which carries out enlargement/reduction processing, the unitprocessing data amount is one line of an image or plural lines of animage. At the image processing module 38 which carries out imagerotating processing, the unit processing data amount is one whole image.At the image processing module 38 which carries out imagecompression/decompression processing, the unit processing data amount isN bytes which depends on the execution environment.

The image processing modules 38, at which the types of the imageprocessings are the same but the contents of the executed imageprocessings are different, also are registered in the module library 36.(In FIG. 1, these types of image processing modules are designated as“module 1” and “module 2”.) For example, with regard to the imageprocessing modules 38 which carry out enlargement/reduction processing,there are plural image processing modules 38 such as the imageprocessing module 38 which carries out reduction processing whichreduces inputted image data by 50% by thinning every other pixel, theimage processing module 38 which carries out enlargement/reductionprocessing at an enlargement/reduction rate which is designated forinputted image data, and the like. Further, for example, with regard tothe image processing modules 38 which carry out color convertingprocessing, there are the image processing module 38 which converts anROB color space into a CMY color space, the image processing module 38which converts the opposite way, and the image processing module 38which carries out another color space conversion such as an L*a*b* spaceor the like.

In order to input the needed amount of the image data for carrying outprocessing at the image processing engine 38, the control section 38Bacquires image data in units of the unit reading data amount from thepreceding module (e.g., the buffer module 40) of its own module (currentmodule), and outputs the image data outputted from the image processingengine 38A to the following module (e.g., the buffer module 40) in unitsof the unit writing data.

If image processing involving an increase or decrease in the data amountsuch as compression or the like is not carried out at the imageprocessing engine 38A, the unit writing data amount equals the unitprocessing data amount. Or, the control section 38B carries out theprocessing of outputting the results of image processing by the imageprocessing engine 38A to the exterior of its own module (e.g., if theimage processing engine 38A carries out image analyzing processing suchas skew angle sensing processing or the like, the results of the imageanalyzing processing, such as the results of sensing the skew angle orthe like, may be outputted instead of the image data). The imageprocessing modules 38, at which the types and contents of the imageprocessings which the image processing engines 38A execute are the samebut the aforementioned unit processing data amount or unit reading dataamount or unit writing data amount are different, also are registered inthe module library 36. For example, although it was previously mentionedthat the unit processing data amount at the image processing module 38which carries out image rotating processing is one whole image, theimage processing module 38, which carries out the same image rotatingprocessing but whose unit processing data amount is one line of an imageor plural lines of an image, may be included in the module library 36.

The program of each of the image processing modules 38 which areregistered in the module library 36 is structured from a program whichcorresponds to the image processing engine 38A and a program whichcorresponds to the control section 38B. The program which corresponds tothe control section 38B is made into a part. The program correspondingto the control section 38B is used in common for the image processingmodules 38 whose unit reading data amounts and unit writing data amountsare the same among the individual image processing modules 38,regardless of the types and contents of the image processings executedat the image processing engines 38A (the same program is used as theprogram corresponding to the control sections 38B). In this way, theburden of development in developing the programs of the image processingmodules 38 is reduced.

Among the image processing modules 38, there are modules, which theattributes of the inputted image are unknown, the unit reading dataamount and the unit writing data amount are not fixed, and theattributes of the input image data are acquired, and the unit readingdata amount and the unit writing data amount are fixed by carrying outarithmetic operation by substituting the acquired attributes intopredetermined arithmetic operation formulas.

With respect to this type of image processing module 38, it suffices forthe program corresponding to the control section 38B to be used incommon at the image processing modules 38 at which the unit reading dataamount and the unit writing data amount are derived by using the samearithmetic operation formula.

Further, the image processing program group 34 can be implemented invarious types of devices as described above. Among the image processingprogram group 34, the numbers and types and the like of the imageprocessing modules 38 which are registered in the module library 36 mayof course be appropriately added, deleted, substituted, and the like, inaccordance with the image processings which are required at the deviceinto which the image processing program group 34 is implemented.

As shown in FIG. 15B, each of the buffer modules 40 structuring theimage processing section 50 is structured from a buffer 40A and a buffercontrol section 40B. The buffer 40A is structured by a memory regionwhich is reserved through the operating system 30 from the memory 14provided at the computer 10. The buffer control section 40B carries outinput and output of image data with the modules at the preceding and thefollowing stages of the buffer module 40, and management of the buffer40A. The buffer control section 40B itself of each buffer module 40 alsois a program which is executed by the CPU 12, and the program of thebuffer control section 40B also is registered in the module library 36.(The program of the buffer control section 40B is designated as “buffermodule” in FIG. 1.)

The processing constructing section 42 which constructs the imageprocessing section 50 instructed by the application 32 is structuredfrom plural types of module generating sections 44 as shown in FIG. 1.The plural types of module generating sections 44 correspond to imageprocessings which differ from one another, and by being started-up bythe application 32, carry out the processings of generating modulegroups from the image processing modules 38 and the buffer modules 40which are for realizing the corresponding image processings.

FIG. 1 illustrates, as examples of the module generating sections 44,the module generating sections 44 which correspond to the types of imageprocessings which are executed by the individual image processingmodules 38 registered the module library 36. The image processingscorresponding to the individual module generating sections 44 may beimage processings which are realized by plural types of the imageprocessing modules 38 (e.g., skew correcting processing which is formedfrom skew angle sensing processing and image rotating processing). In acase in which the needed image processing is a processing which combinesplural types of image processings, the application 32 successivelystarts-up the module generating sections 44 corresponding to any of theplural types of image processings. In this way, the image processingsection 50 which carries out the image processings which are needed, isconstructed by the module generating sections 44 which are successivelystarted-up by the application 32.

As shown in FIG. 1, the processing managing section 46 includes aworkflow managing section 46A which controls the execution of the imageprocessings at the image processing section 50, a resource managingsection 46B which manages the use of the memory 14 and the resources ofthe computer 10, and an error managing section 46C which manages errorswhich arise at the image processing section 50. The image processingsection 50 operates to carry-out image processings in parallel whiletransferring image data to the following stages in units of a dataamount which is smaller than one whole image (which is called block unitprocessing). Also, the section 50 operates such that, after thepreceding image processing module 38 completes image processing on theimage data of one whole image, the following image processing module 38carries out image processing on the image data of one whole image (whichis called whole image processing). As the programs of the workflowmanaging section 46A, there are a program for causing the imageprocessing section 50 to carry out block unit processing, and a programfor causing the image processing section 50 to carry out whole imageprocessing.

Operation of the present embodiment will be described next. When thepower source of the computer 10 is turned on, the resource managingsection 46B starts-up, and the initializing processing is carried out bythe resource managing section 46B as shown in FIG. 2A.

In the present embodiment, there are three types of managing methods asthe methods of managing memory by the resource managing section 46B, andit is possible to select and set by which of these managing methods thememory management is to be carried out. The first is a first managingmethod which, each time there is a request from an individual module ofthe image processing section 50, reserves, from the memory 14 andthrough the operating system 30, a memory region to be allotted to themodule which is the source of the request. The second is a secondmanaging method which reserves a memory region of a given size inadvance from the memory 14 and through the operating system 30, and whenthere is a request from an individual module, allots a partial region ofthe memory region which is reserved in advance, to the module which isthe source of the request. The third is a third managing method whichreserves a memory region of a given size in advance from the memory 14and through the operating system 30, and when there is a request from anindividual module, if the size of the requested memory region is lessthan a threshold value, allots a partial region of the memory regionwhich is reserved in advance to the module which is the source of therequest, and if the size of the requested memory region is greater thanor equal to the threshold value, reserves, through the operating system30, a memory region to be allotted to the module which is the source ofthe request. Note that the present invention is not limited to the same,and other memory managing methods may be used.

The managing method is selected as follows for example. The firstmanaging method is suitable in particular in cases such as when it isused from an application which does not have memory limitations or thelike and it is desired to suppress the increase in the program size dueto complex memory management, or the like. Further, the second managingmethod is suitable in a case in which the memory amount which can beused by the entire application which carries out image processing inaccordance with the present invention is limited, and there is the needto operate within this range. On the other hand, the third managingmethod is suitable in cases in which the processing time needed forreserving and freeing (releasing) the memory must be made to be highspeed, because overhead may increase when using a memoryreserving/freeing function of the operating system 30 in reserving andfreeing minute memory regions.

In step 100 of the initializing processing shown in FIG. 2A, it isjudged whether or not the memory managing method which is selected andset is the second managing method or the third managing method. Thememory managing method may be selected and set at the time ofimplementing the image processing program group 34 into the computer 10.Or, the resource managing section 46B may acquire the system environmentof the computer 10 (e.g., the size of the memory 14, or the type of thedevice in which the image processing program group 34 is implemented, orthe like), and the memory managing method can be automatically selectedand set on the basis of the acquired system environment. If the memorymanaging method is the first managing method, the aforementionedjudgment is negative, and the initializing processing ends. However, ifthis judgment is affirmative, the routine moves on to step 102 where amemory region (continuous region) of a predetermined size is reservedthrough the operating system 30 from the memory 14 provided at thecomputer 10, and the routine ends. The aforementioned predetermined sizeas well may be selected and set in accordance with the systemenvironment or the like.

Here, if the memory managing method is the first managing method, thememory region requested through the operating system 30 is reserved inresponse to a memory reserving request which is generated thereafter,and the memory region is freed through the operating system similarly inresponse to a memory freeing request. Since these processings aresimilar to those used in usual programs, explanation thereof is omitted.

If the memory managing method is the second managing method, in responseto a memory reserving request which is generated thereafter, a memoryregion of a size corresponding to the request is searched for andreserved from the unused region whose state is “unused” among the memoryregion which was reserved in advance in previous step 102. The state ofthe reserved memory region is changed to “used”, and the reserved memoryregion is transferred to the source of the request. For a memory freeingrequest, the memory region for which freeing is requested isincorporated into an unused region of the memory region which wasreserved in advance, and processing is carried out to change the stateof the incorporated memory region from “used” to “unused”. Theinformation expressing whether the states of memory regions are unusedor used can be managed, for example, by a table or a list or the like.

Next, the third managing method will be described. When a memoryreserving request is generated, the processing for a memory reservingrequest as shown in FIG. 2B is carried out by the resource managingsection 46B. In the processing for a memory reserving request, in step104, it is judged whether or not the requested size is less than orequal to a threshold value which is set in advance. If the requestedsize is not less than nor equal to the threshold value, in the same wayas in the first managing method, in step 106, a memory region of therequested size is reserved through the operating system 30, and in step108, the head address of the reserved memory region is registered in atable in the resource managing section 46B. Instead of a table, anothermeans such as a list or an associative array or the like may be used. Ifit is judged in step 104 that the requested size is less than or equalto the threshold value, in the same way as in the second managingmethod, a memory region of the requested size is reserved (step 110)from the unused region of the memory region which was reserved inadvance in previous step 102, and the state of the reserved region ischanged to “used” (step 112). Then, in step 114, the reserved memoryregion is transferred to the source of the request.

Further, in the third managing method, when a memory freeing request isgenerated, the processing for a memory freeing request as shown in FIG.2C is carried out by the resource managing section 46B. In theprocessing for a memory freeing request, in step 116, it is judgedwhether or not the head address of the memory region for which freeingis requested is registered in the aforementioned table. If the judgmentin step 116 is affirmative, the memory region for which freeing isrequested is a memory region reserved through the operating system 30.Therefore, in step 118, the memory region for which freeing is requestedis freed through the operating system 30, and in next step 120, the headaddress of the memory region for which freeing is requested is deletedfrom the aforementioned table. Further, if the judgment in step 116 isnegative, the memory region for which freeing is requested is a memoryregion reserved from the memory region which was reserved in advance inprevious step 102. Accordingly, in step 122, the memory region for whichfreeing is requested is incorporated in the unused region of the memoryregion which was reserved in advance, and the state of the incorporatedmemory region is changed to “unused” in step 124. After theseprocessings, in step 126, the source of the request is notified of thefreeing of the requested memory region, and the processing for a memoryfreeing request ends.

Next, explanation will be given of a case in which reserving/freeing ofa resource other than the memory (e.g., a specific file or the like) isrequested of the resource managing section 46B. When a resourcereserving request is inputted, the resource managing section 46B carriesout the processing for a resource reserving request which is shown inFIG. 2D. In the processing for a resource reserving request, in step130, the resource for which reserving is requested is reserved throughthe operating system 30. In next step 132, the address of the reservedresource is registered in a table in the resource managing section 46Bin correspondence with information identifying the module which is thesource of the request. In step 134, the reserved resource is transferredto the source of the request, and processing ends. Further, when aresource freeing request is inputted, the resource managing section 46Bcarries out the processing for a resource freeing request which is shownin FIG. 2E. In the processing for a resource freeing request, in step136, the information (the addresses of the reserved resources), which isregistered in the table in the resource managing section 46B incorrespondence with the information identifying the module which is thesource of the request, is read. In next step 138, all of the resourceswhich are expressed by the read information are freed through theoperating system 30. Further, in step 140, the table is updated suchthat the information corresponding to the freed resources is deletedfrom the table. In next step 142, the source of the request is notifiedof the freeing of the resources, and processing ends.

In this way, in reserving/freeing resources other than the memory, atthe time of reserving, the reserved resource is registered in a table,and at the time of freeing, the resources which are registered in thetable (the resources reserved in accordance with requests from the samerequesting source) are all freed. Therefore, as compared with a methodin which the resource to be freed is designated by a source of theresource freeing request, it is possible to free the resourcescertainly. In these memory and resource reserving/freeing processings,there are cases in which there are failures in processing frominsufficient resources or the like. In such cases, a processing such asnotifying the error managing section 46C or the like is needed. However,descriptions of such error processings will be omitted here in order tosimplify explanation.

On the other hand, when a situation of implementing an image processingarises at a device which has the image processing program group 34, thissituation is sensed by a specific application 32, and the processingshown in FIG. 3 is carried out by that application 32. There are someexamples of the situation of implementing the image processing, which animage is read by an image reading section which serves as the image datasupplying section 22, and the user instructs execution of a job which isto record the image as an image on a recording material by an imagerecording section serving as the image outputting section 24, or is todisplay the image as an image on a display section serving as the imageoutputting section 24, or which is to write the image data onto arecording medium by a writing device serving as the image outputtingsection 24, or which is to transmit the image data by atransmitting/receiving section serving as the image outputting section24, or which is to store the image data in an image storage sectionserving as the image outputting section 24, or a case in which the userinstructs execution of a job which carries out any of the aforementionedrecording onto a recording material, displaying on a display section,writing to a recording medium, transmitting, and storing in an imagestorage section, on image data which is either received by a receivingsection serving as the image data supplying section 22 or is stored inan image storage section serving as the image data supplying section 22.Further, the situations in which there is a need for image processing tobe carried-out are not limited to those described-above, and may be, forexample, a case in which the processing which is the object of executionis selected by the user in a state in which the names or the like of theprocessings which the applications 32 can execute are displayed in alist on the display 16 in accordance with an instruction from the user,or the like.

When the situation arises, some types of image processing must becarried out as described above. The application 32 first recognizes thetype of the image data supplying section 22 which supplies the imagedata to be processed (refer to step 150 of FIG. 3). When the recognizedtype is a buffer region (a partial region of the memory 14) (i.e., in acase in which the judgment of step 152 in FIG. 3 is affirmative), thebuffer module 40 which includes the buffer region designated as theimage data supplying section 22 is generated (refer to step 154 of FIG.3 as well). The new generation of a buffer module 40, which will bedescribed later, is carried out by the buffer control section 40B. Thebuffer control section 40B is generated by generating a process, thread,or object which executes the program of the buffer control section 40Bof the buffer module 40. The new generation is generated by generating amemory region which is used as the buffer 40A, being reserved by thegenerated buffer control module 40B. However, the generation of thebuffer module 40 in step 154 is achieved by setting parameters whichmake (the buffer control section 40B) recognize the designated bufferregion as the buffer 40A which has already been reserved, and carryingout processing of generating the buffer control section 40B. The buffermodule 40 generated here functions as the image data supplying section22.

Next, in the same way as described above, the application 32 recognizesthe type of the image outputting section 24 which serves as the outputdestination of the image data on which the image processing is carriedout (refer to step 156 of FIG. 3). If the recognized type is a bufferregion (a partial region of the memory 14) (i.e., if the judgment instep 158 of FIG. 3 is affirmative), the buffer module 40 which includesthe buffer region designated as the image outputting section 24 isgenerated in the same way as described above (refer to step 160 of FIG.3). The buffer module 40 which is generated here functions as the imageoutputting section 24. Further, the application 32 recognizes thecontents of the image processing to be executed, and divides the imageprocessing to be executed into a combination of image processings oflevels corresponding to the individual module generating sections 44,and judges the types of the image processings necessary in order torealize the image processing which is to be executed, and the order ofexecution of the individual image processings (refer to step 162 of FIG.3). This judgment can be realized by, for example, the aforementionedtypes of image processings and orders of execution of individual imageprocessings being registered in advance as information in correspondencewith the types of jobs whose execution can be instructed by the user,and the application 32 reading-out the information corresponding to thetype of job for which execution has been instructed.

Then, on the basis of the types of image processings and order ofexecution which were judged in the above, the application 32 starts-upthe module generating section 44 which corresponds to the imageprocessing which is first in the order of execution (i.e., generates aprocess, thread, or object which executes the program of the modulegenerating section 44). Thereafter (refer to step 164 of FIG. 3), theapplication 32 notifies the started-up module generating section 44 of,as information needed for generating a module group by that modulegenerating section 44, input module identification information foridentifying the input module which inputs image data to that modulegroup, output module information for identifying the output module towhich that module group outputs image data, input image attributeinformation expressing the attributes of the input image data which isinputted to that module group, and parameters of the image processingwhich is to be executed, and instructs generation of the correspondingmodule group (refer to step 166 of FIG. 3).

For the module group which is first in the order of execution, the imagedata supplying section 22 is the aforementioned input module. For themodule groups which are second or thereafter in the order of execution,the final module (usually the buffer module 40) of the module group ofthe preceding stage is the input module. Further, at the module groupwhich is last in the order of execution, the image output section 24 isthe aforementioned output module, and therefore, the image outputtingsection 24 is designated as the output module. At the other modulegroups, the output module is not fixed. Therefore, when designation bythe application 32 is not carried out and it is needed, the outputmodule is generated and set by the module generating section 44.Further, the input image attributes and the parameters of the imageprocessings may, for example, be registered in advance as information incorrespondence with the types of jobs for which execution can bedesignated by the user, and the application 32 can recognize them byreading-out the information corresponding to the type of the job forwhich execution is instructed. Or, the input image attributes and theparameters of the image processings may be designated by the user.

On the other hand, when the module generating section 44 is started-upby the application 32, the module generating section 44 carries out themodule generating processing shown in FIG. 4A (refer to step 168 in FIG.3). In the module generating processing, in step 200, it is judgedwhether or not there is an image processing module 38 to be generatednext at the module generating section 44. If the judgment is negative,the module generating processing ends. If there is an image processingmodule 38 to be generated, in step 202, the module generating section 44acquires input image attribute information which expresses theattributes of the input image data. In next step 204, the modulegenerating section 44 judges whether or not, also in view of theattributes of the input image data expressed by the information acquiredin step 202, it is necessary to generate the image processing module 38which was judged in previous step 200 as to be generated.

Specifically, for example, the module generating section 44corresponding to the module generating processing which is beingexecuted, is a module generating section which generates a module groupfor carrying out color converting processing. The CMY color space isdesignated from the application 32 as the color space of the outputimage data by the parameters of the image processing. When the inputimage data is RGB color space data based on the input image attributeinformation acquired in step 202, there is needed to generate the imageprocessing module 38 to convert RGB to CMY color space as the imageprocessing module 38 which carries out the color space processing.However, when the input image data is CMY color space, the attributes ofthe input image data and the attributes of the output image data matchwith respect to the color space, and therefore, it can be judged thatthere is no need to generate the image processing module 38 whichcarries out color space converting processing. If it is judged to beunnecessary, the routine returns to step 200.

When the buffer module 40 exists at the preceding stage of the imageprocessing module 38 which is generated, the processing of acquiring theattributes of the input image data can be realized by acquiring theattributes of output image data from the image processing module 38.Here, the image processing module 38 is the further preceding imageprocessing module 38 from the image processing module 38 which writesimage data to that buffer module 40.

In next step 206, it is judged whether or not the buffer module 40 isneeded at the following stage of the image processing module 38 which isgenerated. This judgment is negative in a case in which the followingstage of the image processing module 38 is an output module (the imageoutputting section 24) (e.g., refer to the image processing module 38 ofthe final stage in the image processing sections 50 shown in FIGS. 5Athrough 5C), or in a case in which the image processing module is amodule which carries out image processing such as analysis or the likeon the image data and outputs the results thereof to another imageprocessing module 38 (e.g., the image processing module 38 which carriesout skew angle sensing processing in the image processing section 50shown in FIG. 5B), and the routine moves on to step 210 withoutgenerating the buffer module 40. In cases other than those describedabove, the judgment is affirmative, and the routine moves on to step 208where, by starting-up the buffer control section 40B (i.e., generating aprocess, thread or object which executes the program of the buffercontrol section 40B), the buffer module 40 which is connected at thefollowing stage of the image processing module 38 is generated. When thebuffer control section 40B is started-up by the module generatingsection 44 (or the aforementioned application 32), the buffer controlprocessing shown in FIG. 6 is carried out. This buffer controlprocessing will be described later.

In next step 210, the image processing module 38 is generated from theinformation of the module of the preceding and following stages (e.g.,both of modules are the buffer module 40), the processing parameters,and the attributes of the input image data.

When it is judged in step 206 that the following buffer module 40 is notneeded, information of the following buffer module 40 is not providedfor the image processing module 38. Also, processing parameters are notprovided in a case in which the processing contents are fixed andspecial image processing parameters are not required, such as inreduction processing of 50% for example.

In the module generating processing (step 210), the image processingmodule 38 is selected from among plural candidate modules which areregistered in the module library 36 to matche the attributes of theinput image data acquired in step 202 and the processing parameterswhich are to be executed at the image processing module 38. For example,when the module generating section 44 generates a module group carryingout color converting processing, and the CMY color space is designatedfrom the application 32 as the color space of the output image databased on the processing parameters. Also, in this case, when the inputimage data is data of the RGB color space, the image processing module38 converts RGB to CMY color space. As described above, the suitableimage processing module 38 for the processing is selected from among theplural types of image processing modules 38 which are registered in themodule library 36 and which carry out various types of color spaceprocessings.

Further, if the image processing module is the image processing module38 which carries out enlargement/reduction processing and the designatedenlargement/reduction ratio is other than 50%, the image processingmodule 38, which carries out enlargement/reduction processing at anenlargement/reduction rate which is designated for the inputted imagedata, is selected. If the designated enlargement/reduction rate is 50%,the image processing module 38, which carries out enlargement/reductionprocessing specialized at an enlargement/reduction rate of 50%, i.e.,which carries out reduction processing which reduces the inputted imagedata by 50% by thinning every other pixel, is selected. The selection ofthe image processing module 38 is not limited to the above. For example,plural image processing modules 38, whose unit processing data amountsin the image processings by the image processing engines 38A aredifferent, may be registered in the module library 36, and the imageprocessing module 38 of the appropriate unit processing data amount maybe selected in accordance with the operational environment, such as thesize of the memory region which can be allotted to the image processingsection 50 or the like (e.g., the smaller the aforementioned size, theimage processing module 38 of an increasingly smaller unit processingdata amount is selected, or the like). Or, the image processing module38 may be selected by the application 32 or the user.

In next step 212, the workflow managing section 46A is notified of agroup which is the ID of the following buffer module 40 and the ID ofthe generated image processing module 38. These IDs are informationwhich can uniquely distinguish these individual modules. For example,the ID may be a number which is applied in the order of generating theindividual modules, or may be the address on the memory of the object ofthe buffer module 40 or the image processing module 38, or the like. Theinformation which is notified to the workflow managing section 46A isheld within the workflow managing section 46A, for example, in the formof a table as shown in FIG. 4B, or in the form of a list, or in the formof an associative array or the like, and is used in later processings.Explanation will continue hereinafter with the information being held inthe form of a table.

In the case of an image processing module 38 which does not have thefollowing buffer module 40 as described previously, processing iscarried out in accordance with the following method for example. In acase in which the image processing module 38 which is generated is oneof the final point of a pipeline or the final point of a directedacyclic graph such as the image processing module 38 which carries outthe output processing in FIG. 5A, that image processing module 38 isreturned, as the output of the module generating section 44, to theapplication 32 which is the call-up source.

Further, in a case, such as the image processing module 38 which carriesout skew angle sensing processing in FIG. 5B, in which the results ofthe image processing at the generated image processing module 38 areused at another image processing module (the image processing module 38which carries out image rotating processing in FIG. 5B), the modulegenerating section 44 instructs repeated execution of processing untilthe processings with respect to that image processing module 38 arecompleted, and acquires the results of processing.

When the processing of step 212 ends, control returns to step 200, andthe module generating section 44 judges whether or not there is an imageprocessing module to be generated next. The individual module generatingsections 44 generate module groups which carry out corresponding, givenimage processings. Therefore, this judgment can be realized byregistering in advance and reading-out information relating to what kindof image processing modules are to be generated in what kind ofconnected relationship for each of the individual module generatingsections 44, or by describing this in a program which operates themodule generating sections 44. For example, in a case in which themodule generating section 44 generates a module group which carries outimage processings which are realized by plural types of image processingmodules 38 (e.g., skew correction processing which is realized by theimage processing module 38 which carries out skew angle sensingprocessing and the image processing module 38 which carries out imagerotating processing), a module group containing two or more imageprocessing modules 38 is generated.

When the application 32 is notified of the completion of generation ofthe module group as described above from the module generating section44 which was instructed to generate the module group, the application 32judges, on the basis of the results of the judgment in step 162 of FIG.3, whether or not, in order to realize the image processings which arerequired, there is the need to also generate module groups which carryout other image processings. If the image processings which requirecombine plural types of image processings, the application 32 starts-upthe other module generating sections 44 corresponding to the individualimage processings, and successively carries out the processing of givingnotice of the information needed for module group generation (refer tosteps 170 and 172 of FIG. 3 as well). Then, due to the above-describedmodule generating processing (FIG. 4) being successively carried out(refer to step 174 in FIG. 3 as well) by the module generating sections44 which are successively started-up, the image processing section 50which carries out the required image processings is constructed as shownas examples in FIGS. 5A through 5C.

According to the present embodiment, when the frequency of execution ofa specific image processing is high or the like, even after the imageprocessing section 50 which carries out the specific image processing isgenerated, the application 32 does not instruct the plural modulegenerating sections 44, which are for generating the image processingsection 50 which carries out the specific image processing, to endprocessing, and retains them as processes, threads or objects. Each timethe need to carry out the specific image processing arises, bysuccessively instructing the module generating sections 44, which remainas processes, threads or objects, to generate module groups, the imageprocessing section 50 which carries out the specific image processingcan be re-generated. In this way, each time the need arises to carry outthe specific image processing, there is no need for processings forrespectively starting-up the corresponding module generating sections44, and the time required to re-generate the image processing section 50which carries out the specific image processing can be shortened.

When started-up by the module generating section 44, the control section38B (see FIG. 15A) of the image processing module 38 carries out theimage processing module initializing processing shown in FIG. 12. Inthis image processing module initializing processing, first, in step250, due to the module generating section 44 carrying out the processingof step 210 of the module generating processing (FIG. 4), the controlsection 38B stores the information of the modules of the preceding andthe following stages of its own module which is provided from the modulegenerating section 44. Further, in next step 252, on the basis of thetype and the contents and the like of the image processing which theimage processing engine 38A of its own module carries out, the controlsection 38B recognizes the size of the memory that its own module usesand other resources that its own module uses. The memory which its ownmodule uses is mainly the memory needed in order for the imageprocessing engine 38A to carry out image processing. However, in a casein which the preceding module is the image data supplying section 22 orin a case in which the following module is the image outputting section24, a memory for a buffer, which is for temporarily storing image dataat times of transmitting and receiving image data to and from themodules of the preceding and the following stages, may be needed.Further, in a case in which information of a table or the like isincluded in the processing parameters, a memory region for holding thismay be needed. Then, in step 254, the resource managing section 46B isinformed of the size which was recognized in step 252, and the resourcemanaging section 46B is requested to reserve a memory region of thenotified size.

In the resource managing processing shown in FIG. 2 (the resourcemanaging section 46B), when reserving of a memory region is requestedfrom the image processing module 38 or the buffer module 40, in a casein which the memory managing method which is selected and set is thefirst managing method for example, a memory region (continuous region)of the size notified from the module, which is the source of the memoryreserving request, is reserved from the memory 14 through the operatingsystem 30. Then, by notifying the module, which is the source of thememory reserving request, of the head address of the reserved memoryregion, the reserved memory region is transferred to the module which isthe source of the memory reserving request. Further, if the memorymanaging method is the second managing method, a memory region(continuous region) of the notified size is reserved from the unusedregion of the memory region which is reserved in advance, and thereserved memory region is changed to “used”, and the reserved memoryregion is transferred to the source of the memory reserving request.Moreover, if the memory managing method which is selected and set is thethird managing method, by executing the above-described processing for amemory reserving request (see FIG. 2B), reserving and transfer of amemory region of the notified size are carried out.

In the image processing module initializing processing shown in FIG. 12(the control section 38B of the image processing module 38), when theneeded memory region is reserved via the resource managing section 46Bthrough the above-described processings, in next step 256, it is judged,on the basis of the processings results of previous step 252, whether ornot (the image processing engine 38A of) its own module needs resourcesother than the memory. If the judgment is negative, the routine moves onto step 262 without any processing being carried out. If the judgment isaffirmative, the routine moves on to step 258 where the resourcemanaging section 46B is notified of the type and the like of theresources other than the memory which its own module needs, and isrequested to reserve the notified other resources, and reserves them.

Next, in step 262, the control section 38B judges the preceding moduleof its own module, and if no preceding module of its own module exists,the routine moves on to step 272. If the preceding module is other thanthe buffer module 40, e.g., is the image data supplying section 22 or aspecific file or the like, initializing processing thereof is carriedout in step 270 as needed, and the routine proceeds to step 272.Further, in a case in which a preceding module of its own module existsand that preceding module is the buffer module 40, the routine proceedsfrom step 262 to step 264, and the data amount of the image dataacquired by reading-out image data one time from the preceding buffermodule 40 (i.e., the unit reading data amount) is recognized. If thenumber of preceding buffer modules 40 of its own module is one, there isone unit reading data amount. However, in a case such as when there areplural preceding buffer modules 40 and the image processing engine 38Acarries out image processing by using image data which is acquired fromeach of the plural buffer modules 40, such as in the case of the imageprocessing module 38 which carries out image composing processing in theimage processing section 50 shown in FIG. 5C for example, the unitreading data amount corresponding to each preceding buffer module 40 isdetermined in accordance with the type and the contents of the imageprocessings which the image processing engine 38A of its own modulecarries out, and the number of the preceding buffer modules 40, and thelike.

In step 266, by notifying a single one of the preceding buffer modules40 of the unit reading data amount which was recognized in step 264, theunit reading data amount for that buffer module 40 is set (refer to (1)of FIG. 15A as well). In next step 268, it is judged whether or not unitreading data amounts are set at all of the preceding buffer modules 40of its own module. If the number of preceding buffer modules 40 of itsown module is one, this judgment is affirmative, and the routine moveson to step 272. If the number of preceding buffer modules 40 is a pluralnumber, the judgment in step 268 is negative, and the routine returns tostep 266, and steps 266 and 268 are repeated until the judgment of step268 becomes affirmative. In this way, unit reading data amounts arerespectively set for all of the preceding buffer modules 40.

In step 272, the control section 38B judges the following module of itsown module. In a case in which the following module of its own module isother than the buffer module 40, e.g., is the image outputting section24 or a specific file or the like, initializing processing thereof iscarried out in step 278 as needed, and the routine moves on to step 280.For example, if the following module is the image outputting section 24which is formed from any of an image recording section, a displaysection, a writing section, or a transmitting section, processings arecarried out with respect to the image outputting section 24 as theaforementioned initializing processing. Here, the processings notifythat image data is outputted in units of a data amount which correspondsto the unit writing data amount. Further, if the following module is thebuffer module 40, the data amount of the writing image data of one time(i.e., the unit writing data amount) is recognized in step 274. Thatunit writing data amount is set at the following buffer module in step276 (refer also to (2) of FIG. 15A), and thereafter, the routine moveson to step 280. In step 280, the module generating section 44 isnotified that this image processing module initializing processing iscompleted, and the image processing module initializing processing ends.

On the other hand, when the buffer control section 40B (see FIG. 15B) ofthe individual buffer module 40 structuring the image processing section50 is started-up by the module generating section 44 or the application32, the buffer control section 40B carries out the buffer controlprocessing shown in FIG. 6. In this buffer control processing, when thebuffer control section 40B is started-up by the module generatingsection 44 or the application 32 and generation of the buffer module 40is instructed, a number of waiting requests is initialized to 0 in step356. In next step 358, it is judged whether or not a unit writing dataamount is notified from the preceding image processing module 38 of itsown module or a unit reading data amount has been notified from thefollowing image processing module 38 of its own module. If the judgmentis negative, the routine moves on to step 362 where it is judged whetheror not unit writing data amounts or unit reading data amounts have beennotified from all of the image processing modules 38 connected to itsown module. If the judgment is negative, the routine returns to step358, and steps 358 and 362 are repeated until the judgment of step 358or step 362 is affirmative.

When the unit writing data amount or the unit reading data amount isnotified from the specific image processing module 38 connected to itsown module, the judgment in step 358 is affirmative, and the routinemoves on to step 360 where the notified unit writing data amount or unitreading data amount is stored. Thereafter, the routine returns to step358. Accordingly, each time the unit writing data amount or the unitreading data amount is notified from the individual image processingmodules 38 due to the processing of step 266 or step 276 of the imageprocessing module initializing processing (FIG. 12) being carried out bythe control sections 38B of the individual image processing modules 38connected to its own module, the notified unit writing data amount orunit reading data amount is stored, and the notified unit writing dataamount or unit reading data amount is set at the buffer module 40 (referto (1) and (2) of FIG. 15B as well).

When the image writing data amounts or the image reading data amountsfrom all of the image processing modules 38 connected to its own moduleare notified, and the notified unit writing data amounts and unitreading data amounts are respectively set, the judgment in step 362 isaffirmative, and the routine proceeds to step 364. In step 364, on thebasis of the unit writing data amounts and the unit reading data amountsrespectively set by the individual image processing modules 38 connectedto its own module, the buffer control section 40B determines the size ofa unit buffer region which is the managing unit of the buffer 40A of itsown module, and stores the determined size of the unit buffer region.The maximum value of the unit writing data amount and the unit readingdata amount which are set at its own module is suitable for the size ofthe unit buffer region. However, the unit writing data amount may be setas the size of the unit buffer region, or the unit reading data amount(in a case in which plural image processing modules 38 are connected atthe following stage of its own module, the maximum value of the unitreading data amounts which are respectively set by the individual imageprocessing modules 38) may be set as the size of the unit buffer region.Or, the least common multiple of the unit data writing amount and the(maximum value of the) unit reading data amount(s) may be set. Or, ifthis least common multiple is less than a predetermined value, the leastcommon multiple may be set, or if the least common multiple is greaterthan or equal to the predetermined value, another value (e.g., any ofthe aforementioned maximum value of the unit writing data amount andunit reading data amount(s), or the unit writing data amount, or the(maximum value of the) unit reading data amount(s)) may be set as thesize of the unit buffer region.

In next step 366, the buffer control section 40B judges whether or not amemory region, which is used as the buffer 40A of its own module, isalready provided. If its own module is generated by the modulegenerating section 44, this judgment is negative, and a buffer flag isset to 0 in step 368. Thereafter, the routine moves on to step 374.Further, if its own module is generated by the application 32 and is abuffer module 40 which functions as the image data supplying section 22or the image outputting section 24, the memory region which is used asthe buffer 40A of its own module already exists. Therefore, the judgmentof step 366 is affirmative, and the routine moves on to step 370. Instep 370, the size of the unit buffer region which was determined inprevious step 364 is changed to the size of the established memoryregion which is used as the buffer 40A of its own module. Further, innext step 372, the buffer flag is set to 1, and thereafter, the routineproceeds to step 374.

In step 374, the buffer control section 40B generates respectiveeffective data pointers which correspond to the individual followingimage processing modules 38 of its own module, and initializes therespective generated effective data pointers. The effective datapointers indicate the head position (the next reading start position)and the end position respectively of the image data (effective data)which is not read by the corresponding following image processing module38, among the image data which is written in the buffer 40A of its ownmodule by the preceding image processing module. In the initializingprocessing of step 374, specific information is usually set, which thespecific information means that effective data does not exist. If itsown module is generated by the application 32 and is the buffer module40 which functions as the image data supplying section 22, there arecases in which image data which is the object of image processing isalready written in the memory region which is used as the buffer 40A ofits own module. In such cases, the head position and the end position ofthat image data are respectively set as the effective data pointerswhich correspond to the individual following image processing modules38.

As described above, the initializing processing at the buffer module 40is completed, in next step 376, the workflow managing section 46A isnotified of the completion of the initialization processing. Further, instep 378, it is judged whether or not a value which is greater than 0 isset as the number of waiting requests for which initial setting wascarried out in previous step 356. If the judgment is negative, theroutine moves on to step 380. It is judged whether or not a deletionnotice which gives notice that the processing of deleting that imageprocessing module 38 is to be carried out, has been received from theimage processing module 38 connected at the preceding or followingstages of its own module. If this judgment as well is negative, theroutine returns to step 378, and step 378 and step 380 are repeateduntil either of the judgments is affirmative.

On the other hand, when the constructing of the image processing section50 which carries out the needed image processings is completed due tothe above-described module generating processing (see FIG. 4) by themodule generating sections 44, the application 32 judges whether theforms of execution of the image processings are block unit processing orwhole image processing. Then, by starting-up processes, threads, orobjects which execute the programs of the workflow managing section 46Acorresponding to the judged forms of execution, the application 32instructs the workflow managing section 46A to execute the imageprocessings by the image processing section 50 (refer also to step 176of FIG. 3).

Different programs are started-up in accordance with the forms ofexecution of the image processings. The workflow managing section 46A ofthe processing managing section 46 carries out the block unit controlprocessing shown in FIG. 16 when the form of execution of an imageprocessing is block unit processing. Also, the 46A carries out the wholeimage control processing shown in FIG. 17 when the form of execution ofan image processing is whole image processing. The block unit processingand the whole image control processing respectively correspond to theimage processing section control processing shown in step 178 of FIG. 3.In the block unit processing or the whole image control processing, dueto the workflow managing section 46A inputting a processing request to apredetermined image processing module 38 among the image processingmodules 38 structuring the image processing section 50, image processingby the image processing section 50 is carried out in a block unit or awhole image form of execution.

Hereinafter, before the overall operation of the image processingsection 50 is described, the processing after the completion of theinitialization processing carried out by the buffer control sections 40Bof the individual buffer modules 40, and the image processing modulecontrol processing carried out by the control sections 38B of theindividual image processing modules 38, will be described in that order.

In the present embodiment, in a case in which the image processingmodule 38 writes image data to the following buffer module 40, a writingrequest is inputted from the image processing module 38 to the buffermodule 40. In a case in which the image processing module 38 reads imagedata from the preceding buffer module 40, a reading request is inputtedfrom the image processing module 38 to the buffer module 40. Therefore,when a writing request is inputted from the preceding image processingmodule 38 of its own module, or when a data request is inputted from thefollowing image processing module 38 of its own module, the buffercontrol section 40B of the buffer module 40 carries out the requestreception interruption processing shown in FIG. 7 due to an interruptionarising. Note that, hereinafter, description which is premised on theoccurrence of an interruption is given, but processing may start due tothe calling-up of a method or function, as in a usual program. In thiscase, a structure may be used in which processing is carried out foreach request, and requests are not queued in a queue as in the followingdescription.

In the request reception interruption processing, first, in step 400,request source identifying information which identifies the requestsource which inputted the writing request or the data request to its ownmodule, and request type information which expresses the type of therequest (write or read), are registered at the end of the queue asrequest information. These queues are formed respectively on thememories which are allotted to the individual buffer modules 40.Further, in next step 402, the number of waiting requests is increasedby one, and the request reception interruption processing ends. Due tothis request reception interruption processing, each time a writingrequest or a reading request is inputted to a specific buffer module 40from the image processing module of the preceding or the followingstages of the specific buffer module 40, the request informationcorresponding to the inputted writing request or reading request issuccessively registered in the queue corresponding to the specificbuffer module 40, and the number of waiting requests is increasedone-by-one.

When the number of waiting requests becomes a value which is greaterthan or equal to 1 due to the above-described request receptioninterruption processing being executed, the judgment of step 378 of thebuffer control processing (FIG. 6) is affirmative, and the routine moveson to step 382 where the request information is taken-out from the headof the queue. In next step 384, on the basis of the request typeinformation which is included in the request information taken-out instep 382, the type (writing or reading) of the request corresponding tothe taken-out request information is judged, and the routine splits inaccordance with the results of this judgment. If the type of request isa writing request, the routine moves on from step 384 to step 386, andthe data writing processing shown in FIG. 8 is carried out.

In the data writing processing, first, in step 410, it is judged whetheror not 1 is set for the buffer flag, i.e., whether or not its own module(current module) is the buffer module 40 generated by the application32. If this judgment is affirmative, because the memory region used asthe buffer 40A is already reserved, the routine moves on to step 422without any processing being carried out. If the judgment in step 410 isnegative, i.e., if its own module is the buffer module 40 generated bythe module generating section 44, the routine proceeds to step 412. Instep 412, it is judged whether or not there exists, among the unitbuffer regions structuring the buffer 40A of its own module, a unitbuffer region having a free-space region (a unit buffer region in whichimage data is not written to the end thereof).

At the buffer region 40 which is generated by the module generatingsection 44, a memory region (unit buffer region) used as the buffer 40Ais not reserved initially, and a unit buffer region is reserved as aunit each time a shortage of memory regions arises. Therefore, when awriting request is first inputted to the buffer module 40, a memoryregion (unit buffer region) which is used as the buffer 40A does notexist, and this judgment will be negative. Further, also after a unitbuffer region which is used as the buffer 40A is reserved throughprocessings which will be described later, the aforementioned judgmentwill be negative in a case in which that unit buffer region just becomesfull as the image data is written to that unit buffer region.

If the judgment in step 412 is negative, the routine moves on to step414. In step 414, the image processing module 38 which is the source ofthe writing request is recognized on the basis of the request sourceidentification information included in the request information taken-outfrom the queue, and the unit writing data amount set by the imageprocessing module 38 which is the source of the writing request isrecognized, and thereafter, it is judged whether or not the recognizedunit writing data amount is greater than the size of the unit bufferregion determined in previous step 364 (FIG. 6). In cases of employingthe maximum value of the unit writing data amount and the unit readingdata amount set at its own module, or employing the unit writing dataamount set at its own module, this judgment will be always negative, andthe routine moves on to step 420. In step 420, the resource managingsection 46B is notified of the size of the memory region which is to bereserved (the size of the unit buffer region), and the resource managingsection 46B is requested to reserve a memory region (a unit bufferregion used in storing image data) which is used as the buffer 40A ofits own module. In this way, due to the processings ofpreviously-described step 104 through step 114 (see FIG. 2B) beingcarried out by the resource managing section 46B, the unit buffer regionis reserved.

Further, in a case in which there exists, among the unit buffer regionsstructuring the buffer 40A of its own module, a unit buffer regionhaving a free-space region, the judgment in step 412 is affirmative, andthe routine proceeds to step 416. In step 416, in the same way as inabove-described step 414, the unit writing data amount set by the imageprocessing module 38 which is the source of the writing request isrecognized, and thereafter, it is judged whether or not the size of thefree-space region in the unit buffer region having a free-space regionis greater than or equal to the recognized unit writing data amount. Ifthe judgment is affirmative, there is no need to newly reserve a unitbuffer region which is used as the buffer 40A of its own module, andtherefore, the routine moves on to step 422 without any processing beingcarried out.

If the size of the unit buffer region is an integer multiple of the unitwriting data amount, each time a writing request is inputted from thepreceding image processing module 38 of its own module, either thejudgments of steps 412, 414 are both negative or the judgments of steps412, 416 are both affirmative as described above, and only the unitbuffer region which is used as the buffer 40A is reserved as needed.

On the other hand, in a case in which the size of the unit buffer regionis not an integer multiple of the unit writing data amount, by repeatingthe writing of the image data of the unit writing data amount to thebuffer 40A (the unit buffer region), a state arises in which the size ofthe free-space region at the unit buffer region having a free-spaceregion is smaller than the unit writing data amount (the judgment ofstep 416 is negative), as also shown in FIG. 9A as an example. Further,in the present embodiment, it is also possible to employ the unitreading data amount set at its own module (or the maximum value thereof)as the size of the unit buffer region. However, if the size thereof issmaller than the unit writing data amount (i.e., if the judgment in step414 is affirmative), the aforementioned state always arises when awriting request is inputted.

As described above, in a case in which the size of the free-space regionin the unit buffer region having a free-space region is smaller than theunit writing data amount, the region in which the image data of the unitwriting data amount is written extends over plural unit buffer regions.However, in the present embodiment, because the memory region which isused as the buffer 40A is reserved in units of the unit buffer region,it is not possible to ensure that unit buffer regions which are reservedat different times will be regions which are continuous on the actualmemory (the memory 14). Therefore, in a case in which the region inwhich the image data is written extends over plural unit buffer regions,i.e., in a case in which the judgment in step 416 is negative or thejudgment in step 414 is affirmative, the routine moves on to step 418.In step 418, the resource managing section 46B is notified of the unitwriting data amount as the size of the memory region which is to bereserved, and the resource managing section 48B is requested to reservea memory region to be used for writing (a buffer region for writing:refer to FIG. 9B). Then, when the buffer region for writing is reserved,in next step 420, reserving of the unit buffer region which is used asthe buffer 40A is carried out.

In step 422, if the size of the free-space region in the unit bufferregion having a free-space region is greater than or equal to the unitwriting data amount, that free-space region is made to be the writeregion. On the other hand, if the size of the free-space region in theunit buffer region having a free-space region is smaller than the unitwriting data amount, the buffer region for writing which is newlyreserved is made to be the write region, and the image processing module38 which is the source of the writing request is notified of the headaddress of that write region, and is asked to write the image data whichis the object of writing, in order from the notified head address. Inthis way, the image processing module 38 which is the source of thewriting request writes the image data to the write region whose headaddress has been notified (the unit buffer region or the buffer regionfor writing) (see FIG. 9B). As described above, if the region in whichthe image data is written extends over plural unit buffer regions, thebuffer region for writing is reserved separately. Accordingly,regardless of whether or not the region in which the image data iswritten extends over plural unit buffer regions, the notification of thewrite region to the image processing module 38 which is the source ofthe writing request is achieved merely by giving notice of the headaddress thereof as described above, and the interface with the imageprocessing module 38 will be simple.

In next step 424, it is judged whether or not the writing of the imagedata to the write region by the preceding image processing module 38 iscompleted, and step 424 is repeated until the judgment is affirmative.When notice of the completion of writing is given from the precedingimage processing module 38, the judgment of step 424 is affirmative, andthe routine moves on to step 426. In step 426, it is judged whether ornot the write region in the above-described writing processing is thebuffer region for writing which was reserved in previous step 416. Ifthis judgment is negative, the routine proceeds to step 432 without anyprocessing being carried out. If the judgment of step 426 isaffirmative, the routine proceeds to step 428. In step 428, as shown asan example in FIG. 9C, the image data written to the buffer region forwriting is copied in a state of being divided between the unit bufferregion having a free-space region and the new unit buffer regionreserved in previous step 422. Further, in step 430, the resourcemanaging section 46B is notified of the head address of the memoryregion which was reserved as the buffer region for writing in previousstep 418, and the resource managing section 46B is requested to freethat memory region.

Here, explanation is given of an embodiment in which the buffer regionfor writing is reserved when needed, and is freed right away when it isno longer needed. However, in a case in which the size of the unitbuffer region for storage is not an integer multiple of the unit writingdata amount, the buffer region for writing is absolutely necessary.Therefore, a structure may be used in which it is reserved at the timeof initialization and freed at the time when the buffer module 40 isdeleted.

When freeing of the memory region is requested from the image processingmodule 38 or the buffer module 40, the resource managing section 46Bcarries out the processing of freeing memory corresponding to the memorymanaging method which is selected and set. For example, if the memorymanaging method is the third managing method, the processing for amemory freeing request of FIG. 2C is carried out, and the freeing of thememory region is carried out.

In the data writing processing (FIG. 8), the routine moves on to step432 when the judgment in step 426 is negative, or when notification ofthe completion of freeing is given from the resource managing section46B after freeing of the memory is requested in step 430. In step 432,among the effective data pointers corresponding to the individualfollowing image processing modules 38 of its own module, the pointersexpressing the end positions of the effective data are respectivelyupdated (refer to FIG. 9C). The updating of the pointer is achieved bymoving the end position of the effective data which is indicated by thepointer, rearward by an amount corresponding to the unit writing dataamount. In a case in which the image data which is written this time bythe preceding image processing module 38 of its own module is datacorresponding to the end of the image data which is the object ofprocessing, when the writing processing by the preceding imageprocessing module 38 is completed, an entire processing ended notice,which expresses that the image data which is the object of processinghas ended, is given, and the size of the written image data is inputtedfrom the preceding image processing module 38.

Therefore, in a case in which an entire processing ended notice isinputted from the preceding image processing module 38 when writingprocessing is completed, pointer updating is carried out by moving theend position of the effective data rearward by an amount correspondingto the size which is notified simultaneously.

In next step 434, on the basis of whether or not the entire processingended notice is inputted at the time of completion of writingprocessing, it is judged whether or not writing of the image data whichis the object of processing to the buffer 40A is completed. If thejudgment is negative, the routine moves on to step 438 without anyprocessing being carried out. However, if the judgment is affirmative,the routine proceeds to step 436 where data final position information,which expresses that this is the end of the image data which is theobject of processing, is added to the pointer updated in step 432 (thepointer showing the end position of the effective data, among theeffective pointers corresponding to the individual following imageprocessing modules 38 of its own module). Thereafter, the routineproceeds to step 438. Then, in step 438, the number of waiting requestsis reduced by 1, the data writing processing ends, and the routinereturns to step 378 of the buffer control processing (FIG. 6).

In the buffer control processing (FIG. 6), in a case in which the typeof the request corresponding to the request information which wastaken-out in step 382 is reading, the routine moves on from step 384 tostep 388, and the data reading processing shown in FIG. 10 is carriedout. In the data reading processing, first, in step 450, on the basis ofthe request source identification information included in the requestinformation taken-out from the queue, the image processing module 38which is the source of the reading request is recognized, and the unitreading data amount set by the image processing module 38 which is thesource of the reading request is recognized. Based on the effective datapointers corresponding to the image processing module 38 which is thesource of the reading request, the head position and the end position onthe buffer 40A of the effective data corresponding to the imageprocessing module 38 which is the source of the reading request arerecognized.

In next step 452, based on the head position and the end position of theeffective data which were recognized in step 450, it is judged whetheror not the effective data corresponding to the image processing module38 which is the source of the reading request (the image data which canbe read by the image processing module 38 which is the source of thereading request) is greater than or equal to the unit reading dataamount.

If this judgment is negative, the routine moves on to step 454 where itis judged whether or not the end of the effective data is the end of theimage data which is the object of processing, which the effective datais stored in the buffer 40A and which can be read by the imageprocessing module 38 which is the source of the reading request.

The judgment in step 452 or step 454 is affirmative and the routineproceeds to step 456 in cases. One example of the cases is that theeffective data corresponding to the image processing module 38 which isthe source of the reading request is stored in the buffer 40A in anamount greater than or equal to the unit reading data amount. Anotherexample of the cases is that although the effective data which is storedin the buffer 40A and corresponds to the image processing module 38which is the source of the reading request is less than the unit readingdata amount, the end of this effective data is the end of the image datawhich is the object of processing. In step 456, on the basis of the headposition of the effective data which was recognized in previous step450, the unit buffer region is recognized, which the unit buffer regionstores the image data of the head portion of the effective data.Further, by judging whether or not the data amount of the effective datastored in the recognized unit buffer region is greater than or equal tothe unit reading data amount recognized in step 450, it is judgedwhether or not the effective data which is the object of reading thistime extends over plural unit buffer regions.

If the judgment of step 456 is negative, the routine proceeds to step462 without any processing being carried out. Here, as shown in FIG. 11Afor example, cases, in which the data amount of the effective datastored in the unit buffer region which stores the image data of the headportion of the effective data is less than the unit reading data amountand the effective data which is the object of reading this time extendsover plural unit buffer regions, are not limited to the effective datawhich is the object of reading this time being stored in regions whichare continuous on the actual memory (the memory 14). Therefore, if thejudgment in step 456 is affirmative, the routine moves on to step 460where the resource managing section 46B is notified of the unit readingdata amount corresponding to the image processing module 38 which is thesource of the reading request, as the size of the memory region which isto be reserved, and the resource managing section 46B is requested toreserve a memory region which is used in reading (buffer region forreading: see FIG. 11B). When the buffer region for reading is reserved,in next step 460, the effective data, which is the object of reading andwhich is stored over plural unit buffer regions, is copied to the bufferregion for reading which was reserved in step 458 (refer to FIG. 11B aswell).

In step 462, if the effective data which is the object of reading isstored in a single unit buffer region, the region, which is storing theeffective data which is the object of reading, among that unit bufferregion is made to be the read region. On the other hand, if theeffective data which is the object of reading is stored over plural unitbuffer regions, the buffer region for reading is used as the readregion, and the image processing module 38 which is the source of thereading request is notified of the head address of that read region, andis asked to read the image data in order from the notified head address.In this way, the image processing module 38 which is the source of thereading request carries out reading of the image data from the readregion whose head address was notified (the unit buffer region or thebuffer region for reading) (see FIG. 11C as well). In a case in whichthe effective data to be the object of reading is data corresponding tothe end of the image data to be the object of processing (i.e., in acase in which the end position of the effective data which is the objectof reading coincides with the end position of the effective data whichis indicated by the effective data pointer corresponding to the imageprocessing module 38 which is the source of the reading request, anddata final position information is added to that pointer), the imageprocessing module 38 which is the source of the reading request is alsonotified of the size of the effective data which is the object ofreading and of the fact that this is the end of the image data which isthe object of processing.

As described above, in a case in which the effective data to be theobject of reading is stored so as to extend over plural unit bufferregions, the effective data to be the object of reading is copied to thebuffer region for reading which is reserved separately. Therefore,regardless of whether or not the effective data which is the object ofreading is stored over plural unit buffer regions, the notification ofthe read region to the image processing module 38 which is the source ofthe reading request is achieved merely by giving notice of the headaddress thereof as described above, and the interface with the imageprocessing module 38 can be simple. In a case in which its own module isthe buffer module 40 generated by the application 32, the memory regionused as the buffer 40A (the aggregate of the unit buffer regions) is acontinuous region. Accordingly, the following is possible: beforecarrying out the judgment of step 456, it is judged whether or not thebuffer flag is 1, and if the judgment is affirmative, the routine moveson to step 462 regardless of whether or not the effective data which isthe object of reading is stored over plural unit buffer regions.

In next step 464, it is judged whether or not reading of the image datafrom the read region by the image reading module 38 which is the sourceof the reading request is completed, and step 464 is repeated until thisjudgment is affirmative. When the completion of reading is notified fromthe image processing module 38 which is the source of the readingrequest, the judgment of step 464 is affirmative, and the routineproceeds to step 466 where it is judged whether or not the read regionin the above-described reading processing is the buffer region forreading which was reserved in previous step 458. If the judgment isnegative, the routine proceeds to step 470 without any processing beingcarried out. If the judgment in step 466 is affirmative, the routinemoves on to step 468 where the resource managing section 46B is notifiedof the size and the head address of the memory region which was reservedas the buffer region for reading in previous step 458, and the resourcemanaging section 46B is requested to free that memory region. For thebuffer region for reading as well, in the same way as with the bufferregion for writing, if the size of the unit buffer region for storage isnot an integer multiple of the unit reading data amount, the bufferregion for reading is absolutely necessary. Therefore, a structure maybe used in which it is reserved at the time of initialization and freedat the time when the buffer module 40 is deleted.

In next step 470, among the effective data pointers corresponding to theimage processing module 38 which is the source of the reading request,the pointer indicating the head position of the effective data isupdated (refer also to FIG. 11C). The updating of the pointer isachieved by moving the head position of the effective data which isindicated by the pointer, rearward by an amount corresponding to theunit reading data amount. If the effective data which is the object ofreading this time is data corresponding to the end of the image datawhich is the object of processing, pointer updating is carried out bymoving the head position of the effective data rearward by an amountcorresponding to the size of the effective data which is the object ofreading this time which was notified also to the image processing module38 which is the source of the reading request.

In step 472, the effective data pointers corresponding to the individualfollowing image processing modules 38 are respectively referred to, andit is judged whether or not, due to the pointer updating of step 470, aunit buffer region for which reading of the stored image data by therespective following image processing modules 38 has all been completed,i.e., a unit buffer region in which no effective data is stored, hasappeared among the unit buffer regions structuring the buffer 40A. Ifthe judgment is negative, the routine proceeds to step 478 without anyprocessing being carried out. If the judgment is affirmative, theroutine proceeds to step 474 where it is judged whether or not thebuffer flag is 1. If its own module is the buffer module 40 generated bythe module generating section 44, the judgment is negative and theroutine proceeds to step 476 where the resource managing section 46B isrequested to free the unit buffer region in which no effective data isstored.

If its own module is the buffer module 40 generated by the application32, the judgment in step 474 is affirmative, and the routine moves on tostep 478 without any processing being carried out. Accordingly, if abuffer region (memory region) designated by the user is used as thebuffer 40A, that buffer region is stored without being freed. Then, instep 478, the number of waiting requests is decreased by 1, the datareading processing ends, and the routine returns to step 378 of thebuffer control processing (FIG. 6).

On the other hand, in a case in which the data amount of the effectivedata which is stored in the buffer 40A and which can be read by theimage processing module 38 which is the source of the reading request isless than the unit reading data amount, and the end of the effectivedata which can be read is not the end of the image data which is theobject of processing (i.e., in a case in which it is sensed that thereis no readable effective data in (4) of FIG. 15B), the judgments ofsteps 452 and 454 are both negative, and the routine proceeds to step480. In step 480, a data request, which requests new image data, isoutputted to the workflow managing section 46A (see (5) in FIG. 15B aswell). In this case, a processing request is inputted by the workflowmanaging section 46A to the preceding image processing module 38 of itsown module. Further, in step 482, the request information, which wastaken-out from the queue in previous step 382 (FIG. 6), is againregistered at the end of the original queue, and the data readingprocessing ends.

As shown in FIG. 6, when the data reading processing ends, the routinereturns to step 378. In this case, if no other request information isregistered in the queue, the request information which is registeredagain at the end of the queue is immediately taken-out again from thequeue, and the data reading processing of FIG. 10 is again executed. Ifother request information is registered in the queue, the other requestinformation is taken-out and processing corresponding thereto is carriedout, and thereafter, the request information which is registered againat the end of the queue is again taken-out from the queue, and the datareading processing of FIG. 10 is executed again. Accordingly, in a casein which a reading request from the following image processing module 38is inputted but the data amount of the effective data which can be readby the image processing module 38 which is the source of the readingrequest is less than the unit reading data amount, and the end of theeffective data which can be read is not the end of the image data whichis the object of processing, the corresponding request information isstored and the data reading processing is executed repeatedly untileither the data amount of the effective data which can be read becomesgreater than or equal to the unit reading data amount, or it is sensedthat the end of the effective data which can be read is the end of theimage data which is the object of processing (i.e., until the judgmentof step 452 or step 454 is affirmative).

Although details thereof will be described later, when a data request isinputted from the buffer module 40, the workflow managing section 46Ainputs a processing request to the preceding image processing module 38of the buffer module 40 which is the source of the data request (referto (6) in FIG. 15B as well). Due to processing which is triggered by theinput of this processing request and which is carried out at the controlsection 38B of the preceding image processing module 38, when thepreceding image processing module 38 becomes able to write image data tothe buffer module 40, due to a writing request being inputted from thepreceding image processing module 38, the above-described data writingprocessing (FIG. 8) is carried out, and image data is written to thebuffer 40A of the buffer module 40 from the preceding image processingmodule 38 (refer also to (7), (8) of FIG. 15B). In this way, reading ofthe image data from the buffer 40A by the following image processingmodule 38 is carried out (refer also to (9) of FIG. 15B).

As described above, in the buffer control processing relating to thepresent embodiment, each time either a writing request is inputted fromthe preceding image processing module 38 or a reading request isinputted from the following image processing module, the inputtedrequest is registered in a queue as request information, and the requestinformation is taken-out one-by-one from the queue and processed.Therefore, even in cases such as when a reading request is inputtedduring execution of the data writing processing or a writing request isinputted during execution of the data reading processing, exclusivecontrol, which stops execution of the processing corresponding to theinputted request, is carried out until the processing being executed iscompleted and a state arises in which processing corresponding to theinputted request can be executed. In this way, even if the CPU 12 of thecomputer 10 executes in parallel processes or threads corresponding toindividual modules structuring the image processing section 50, it ispossible to avoid the occurrence of problems due to plural requestsbeing inputted simultaneously or substantially simultaneously to asingle buffer module 40. Accordingly, the CPU 12 of the computer 10 canexecute in parallel processes or threads corresponding to individualmodules. Of course, the buffer module may be realized as a usual programor object.

Next, description will be given of image processing module controlprocessing (FIG. 13) which is carried out by the respective controlsections 38B of the individual image processing modules 38, each time aprocessing request is inputted from the workflow managing section 46A tothe individual image processing modules 38 structuring the imageprocessing section 50. In the image processing module controlprocessing, first, in step 284, in a case in which a preceding module(the buffer module 40, or the image data supplying section 22, the imageprocessing module 38, or the like) of its own module exists, data (imagedata, or the results of processing of image processing such as analysisor the like) is requested from that preceding module. In next step 286,it is judged whether data can be acquired from the preceding module. Ifthe judgment is negative, in step 288, it is judged whether or notnotification has been given of the ending of the entire processing. Ifthe judgment of step 288 is negative, the routine returns to step 286,and steps 286 and 288 are repeated until it becomes possible to acquiredata from the preceding module. If the judgment in step 286 isaffirmative, in step 290, data acquiring processing, which acquires datafrom the preceding module, is carried out.

Here, when the preceding module of its own module is the buffer module40, when data is requested in previous step 284 (a reading request)immediately, the head address of the read region is notified from thebuffer module 40 and reading of the data is asked for (see step 462 ofFIG. 10), if there is a state in which the effective data which can beread is stored in the buffer 40A of the buffer module 40 in an amountwhich is greater than or equal to the unit reading data amount, or theend of the effective data which can be read coincides with the end ofthe image data which is the object of processing. If neither of thesestates exists, as the preceding image processing module 38 of the buffermodule 40 writes image data to the buffer 40A of that buffer module 40,the state changes to the aforementioned state, and thereafter, the headaddress of the read region is notified from the buffer module 40 andreading of the image data is asked for (see step 462 of FIG. 10). Inthis way, the judgment of step 286 is affirmative, and the routineproceeds to step 290. In step 290, data acquiring processing, whichreads image data of the unit reading data amount (or a data amount lessthan that) from the read region whose head address has been notified bythe preceding buffer module 40, is carried out (refer to (3) in FIG.15A).

Further, if the preceding module of its own module is the image datasupplying section 22, when a data request is outputted in previous step284, notification is given immediately from the image data supplyingsection 22 of the preceding stage that there is a state in which imagedata can be acquired. In this way, the judgment of step 286 isaffirmative, and the routine proceeds to step 290 where image dataacquiring processing, which acquires image data of the unit reading dataamount from the image data supplying section 22 of the preceding stage,is carried out. Further, if the preceding module of its own module isthe image processing module 38, when a data request (processing request)is outputted in previous step 284, if there is a state in which thepreceding image processing module 38 can execute image processing, dueto a writing request being inputted, notification is given that there isa state in which data (the results of image processing) can be acquired.Therefore, the judgment of step 286 is affirmative, and the routineproceeds to step 290. Due to the preceding image processing module 38giving notice of the address of the buffer region in which data is to bewritten and asking for writing, data acquiring processing is carried outwhich writes, to that buffer, the data outputted from the precedingimage processing module 38.

In next step 292, the control section 38B judges whether or not pluralmodules are connected at the preceding stage of its own module. If thejudgment is negative, the routine moves on to step 296 without anyprocessing being carried out. If the judgment is affirmative, theroutine proceeds to step 294 where it is judged whether or not data hasbeen acquired from all of the preceding modules. If the judgment in step294 is negative, the routine returns to step 284, and step 284 throughstep 294 are repeated until the judgment of step 294 is affirmative.When all of the data which is to be acquired from the preceding modulesis gathered, either the judgment of step 292 is negative or the judgmentof step 294 is affirmative, and the routine moves on to step 296.

Next, in step 296, the control section 38B requests the following moduleof its own module for a region for data output. In step 298, judgment isrepeated until a data output region can be acquired (i.e., until thehead address of a data output region is notified). Note that, if thefollowing module is the buffer module 40, the aforementioned request fora region for data output is formed by outputting a writing request tothat buffer module 40. When a data output region (if the followingmodule is the buffer module 40, a write region whose head address isnotified from that buffer module 40) can be acquired (refer to (4) inFIG. 15A), in next step 300, the data obtained by the previous dataacquiring processing and (the head address of) the data output regionacquired from the following module are inputted to the image processingengine 38A. A predetermined image processing is carried out on theinputted data (see (5) of FIG. 15A), and the data after processing iswritten to the data output region (see (6) of FIG. 15A). When input ofdata of the unit reading data amount to the image processing engine 38Ais completed and the data outputted from the image processing engine 38Ais all written to the data output region, in next step 302, thefollowing module is notified that output is completed.

Due to above-described step 284 through step 302, the processing of dataof the unit processing data amount (i.e., unit processing) at the imageprocessing module 38 is completed. There are cases in which the numberof times of execution of the unit processing is designated by theworkflow managing section 46A in the processing request which isinputted from the workflow managing section 46A to the image processingmodule 38. Therefore, in step 304, it is judged whether or not thenumber of times of execution of the unit processing has reached thenumber of times of execution instructed by the inputted processingrequest. If the instructed number of times of execution of the unitprocessing is one time, this judgment is unconditionally affirmative.However, if the instructed number of times of execution of the unitprocessing is greater than or equal to 2, the routine returns to step284, and step 284 through step 304 are repeated until the judgment ofstep 304 is affirmative. When the judgment of step 304 is affirmative,the routine proceeds to step 306. In step 306, by outputting aprocessing completed notice to the workflow managing section 46A, thecontrol section 38B notifies the workflow managing section 46A thatprocessing corresponding to the inputted processing request iscompleted, and the image processing module control processing ends.

Further, when processing is carried out until the end of the image datawhich is the object of processing due to the above-described processingsbeing repeated each time a processing request is inputted from theworkflow managing section 46A, the judgment of step 288 becomesaffirmative due to notice of the end of the image data which is theobject of processing being given from the preceding module, and theroutine moves on to step 308. In step 308, the control section 38Boutputs an entire processing completed notice, which means thatprocessing of the image data which is the object of processing iscompleted, to the workflow managing section 46A and to the followingmodule. In next step 310, self-module deletion processing (to bedescribed later) is carried out, and the image processing module controlprocessing ends.

Note that the image processing engine 38A, which carries out the imageanalyzing processing such as skew angle sensing processing or the like,is often structured such that the image processing results are notoutputted in units of the unit reading data amount, but the imageprocessing results are outputted after all of the image data which isthe object of processing has been inputted. At the control section 38Bof an image processing module 38 having such an image processing engine38A, steps 296 and 298 of the image processing module control processing(FIG. 13) and output of data to the following module in step 300 are notcarried out, and when the judgment in step 288 is affirmative due to theimage data which is the object of processing being processed until theend, the data (image processing results) outputted from the imageprocessing engine 38A is outputted to the exterior of its own module (tothe workflow managing section 46A or the application 32). Then, if thereis another image processing module 38 which requires the above-describedimage processing results (e.g., the image processing module 38 whichcarries out image rotating processing on the basis of the results of theskew angle sensing processing, or the like), the aforementioned imageprocessing results are inputted from the workflow managing section 46Aor the application 32 to that image processing module 38.

On the other hand, in a case in which block unit processing isdesignated as the form of execution of the image processing, when theworkflow managing section 46A is started-up by the application 32, theblock unit control processing 1 shown in FIG. 16A is carried out. Asdescribed above as well, in the input of a processing request from theworkflow managing section 46A to the individual image processing modules38 of the image processing section 50, it is possible to designate thenumber of times of execution of the unit processing. In step 500 of theblock unit control processing 1, the number of times of execution of theunit processing designated in a processing request of one time is setfor each of the individual image processing modules 38. The number oftimes of execution of the unit processing per processing request of onetime can be determined such that, for example, the number of times ofinput of the processing request to the individual image processingmodules 38 during the time that all of the image data which is theobject of processing is being processed, is averaged, or may bedetermined in accordance with another standard. Then, in next step 502,a processing request is inputted to the image processing module 38 ofthe final stage of the image processing section 50 (refer to (1) of FIG.18 as well), and the block unit control processing 1 ends.

Here, in the image processing section 50 shown in FIG. 18, when aprocessing request is inputted from the workflow managing section 46A toan image processing module 384 of the final stage, the control section38B of the image processing module 384 inputs a reading request to apreceding buffer module 403 (refer to (2) of FIG. 18). At this time, noeffective data (image data) which can be read by the image processingmodule 384 is stored in the buffer 40A of the buffer module 403.Therefore, the buffer control section 40B of the buffer module 403inputs a data request to the workflow managing section 46A (refer to (3)of FIG. 18).

In a case in which the form of execution of the image processing isblock unit processing, each time a data request is inputted from thebuffer module 40, the block unit control processing 2 shown in FIG. 16Bis carried out. In this block unit control processing 2, in step 504, onthe basis of the information registered in the table shown in FIG. 4B,the preceding image processing module 38 (here, an image processingmodule 38 ₃) of the buffer module 40 which is the input source of thedata request (here, the buffer module 40 ₃), is recognized, and aprocessing request is inputted to the recognized preceding imageprocessing module 38 (refer to (4) of FIG. 18), and the processing ends.

When a processing request is inputted, the control section 38B of theimage processing module 38 ₃ inputs a reading request to a precedingbuffer module 40 ₂ (refer to (5) of FIG. 18). Because image data whichcan be read is also not stored in the buffer 40A of the buffer module402, the buffer control section 40B of the buffer module 402 inputs adata request to the workflow managing section 46A (refer to (6) of FIG.18). Also when a data request is inputted from the buffer module 40 ₂,the workflow managing section 46A again carries out the above-describedblock unit control processing 2, and thereby inputs a processing requestto an preceding image processing module 38 ₂ (refer to (7) of FIG. 18).The control section 38B of the image processing module 38 ₂ inputs areading request to a preceding buffer module 40 ₁ of (refer to (8) ofFIG. 18). Further, because image data which can be read is also notstored in the buffer 40A of the buffer module 40 ₁, the buffer controlsection 40B of the buffer module 40 ₁ also inputs a data request to theworkflow managing section 46A (refer to (9) of FIG. 18). Also when adata request is inputted from the buffer module 40 ₁, the workflowmanaging section 46A again carries out the above-described block unitcontrol processing 2, and thereby inputs a processing request to anpreceding image processing module 38 ₁ (refer to (10) of FIG. 18).

Here, the preceding module of the image processing module 38 ₁ is theimage data supplying section 22. Therefore, by inputting a data requestto the image data supplying section 22, the control section 38B of theimage processing module 38 ₁ acquires image data of the unit readingdata amount from the image data supplying section 22 (refer to (11) ofFIG. 18). The image data, which is obtained by the image processingengine 38A carrying out image processing on the acquired image data, iswritten to the buffer 40A of the following buffer module 40, (refer to(12) of FIG. 18). Note that, when the control section 38B of the imageprocessing module 38, finishes the writing of image data to the buffer40A of the following buffer module 40 ₁, the control section 38B inputsa processing completed notice to the workflow managing section 46A.

In a case in which the form of execution of the image processing isblock unit processing, each time a processing completed notice isinputted from the image processing module 38, the workflow managingsection 46A carries out the block unit control processing 3 shown inFIG. 16C. In this block unit control processing 3, in step 506, it isjudged whether or not the source of the processing completed notice isthe image processing module 38 of the final stage of the imageprocessing section 50. If the judgment is negative in this case, theprocessing ends without any processing being carried out (the same holdsfor cases in which a processing completed notice is inputted from theimage processing module 38 ₂, 38 ₃).

Further, when effective data, which can be read by the following imageprocessing module 382 and which is of an amount which is greater than orequal to the unit reading data amount, is written, the buffer controlsection 40B of the buffer module 40, requests reading to the imageprocessing module 38 ₂.

Accompanying this, the control section 38B of the image processingmodule 382 reads image data of the unit reading data amount from thebuffer 40A of the buffer module 40, (refer to (13) of FIG. 18), and theimage processing engine 38A carries out image processing on the acquiredimage data. The image data obtained in this way is written to the buffer40A of the following buffer module 40 ₂ (refer to (14) of FIG. 18). Wheneffective data, which can be read by the following image processingmodule 38 ₃ and which is of an amount which is greater than or equal tothe unit reading data amount, is written, the buffer control section 40Bof the buffer module 40 ₂ requests reading to the image processingmodule 38 ₃. The control section 38B of the image processing module 38 ₃reads image data of the unit reading data amount from the buffer 40A ofthe buffer module 40 ₂ (refer to (15) of FIG. 18), and the imageprocessing engine 38A carries out image processing on the acquired imagedata. The image data obtained in this way is written to the buffer 40Aof the following buffer module 40 ₃ (refer to (16) of FIG. 18).

Further, when effective data, which can be read by the following imageprocessing module 384 and which is of an amount which is greater than orequal to the unit reading data amount, is written, the buffer controlsection 40B of the buffer module 40 ₃ requests reading to the imageprocessing module 38 ₄. Accompanying this, the control section 38B ofthe image processing module 38 ₄ reads image data of the unit readingdata amount from the buffer 40A of the buffer module 40 ₃ (refer to (17)of FIG. 18), and the image processing engine 38A carries out imageprocessing on the acquired image data. The image data obtained in thisway is outputted to the image outputting section 24 which is thefollowing module (refer to (18) of FIG. 18). Further, when the controlsection 38B of the image processing module 38 ₄ completes the writing ofimage data to the image outputting section 24, the control section 38Binputs a processing completed notice to the workflow managing section46A (refer to (19) in FIG. 18). In this case, the judgment in step 506of the aforementioned block unit control processing 3 is affirmative,and the routine proceeds to step 508 where a processing request is againinputted to the image processing module 38 ₄ which is the final-stageimage processing module 38, and thereafter, processing ends.

Due to a processing request being re-inputted to the image processingmodule 384 which is the final stage, the above-described processingsequence is repeated again, and image processing, which is in a form ofexecution of block units, is successively carried out on the image datawhich is the object of processing. When the image data supplied from theimage data supplying section 22 reaches the end of it, input of entireprocessing ended notices from the individual image processing modules 38to the workflow managing section 46A is successively carried out fromthe preceding image processing modules 38.

In a case in which the form of execution of the image processing isblock unit processing, each time an entire processing ended notice isinputted from the image processing module 38, the workflow managingsection 46A carries out the block unit control processing 4 shown inFIG. 16D. In this block unit control processing 4, in step 510, it isjudged whether or not the image processing module 38, which is thesource of input of the entire processing ended notice, is the imageprocessing module 38 of the final stage. If this judgment is negative,processing ends without any processing being carried out. In a case inwhich an entire processing ended notice is inputted from the imageprocessing module 38 of the final stage due to all of the image data,which is obtained by the necessary image processings being carried outon the image data which is the object of processing, being outputted tothe image outputting section 24, the judgment of step 510 isaffirmative, and the routine moves on to step 512. In step 512; theapplication 32 is notified of the completion of image processing (referto step 180 of FIG. 3 as well), and the block unit control processingends. Then, the application 32, which has been notified of thecompletion of image processing, notifies the user that image processinghas been completed (refer to step 182 in FIG. 3 as well).

In this way, in the block unit processing, a processing request inputtedto the image processing module 38 of the final stage is transferredbackward to the preceding image processing modules 38. When theprocessing request reaches the image processing module 38 of theforward-most stage, a series of image processings is carried out by aflow in which image processing is carried out at the image processingmodule 38 of the forward-most stage, data is written to the followingbuffer module 40, and if the written data suffices, the processingproceeds to the following module.

In a case in which whole image processing is designated as the form ofexecution of the image processing, when the workflow managing section46A is started-up by the application 32, the whole image controlprocessing 1 shown in FIG. 17A is carried out. In the whole imagecontrol processing 1, in the same way as in the above-described blockunit control processing 1 (FIG. 16A), the number of times of executionof the unit processing designated by a processing request of one time,is set for each of the individual image processing modules 38 (step540). In next step 542, a processing request is inputted to the imageprocessing module 38 of the final stage in the image processing section50 (refer to (1) of FIG. 18), and processing ends. Further, in a case inwhich the form of execution of the image processing is whole imageprocessing, each time a data request is inputted from the buffer module40, the workflow managing section 46A carries out the whole imagecontrol processing 2 shown in FIG. 17B. In the whole image controlprocessing 2, in the same way as in the above-described block unitcontrol processing 2 (FIG. 16B), in step 544, on the basis ofinformation registered in the table shown in FIG. 4B, the precedingimage processing module 38 of the buffer module 40 which is the sourceof input of the data request is recognized, a processing request isinputted to the recognized preceding image processing module 38, andprocessing ends.

In this way, even if the form of execution of the image processing iswhole image processing, the processing which the workflow managingsection 46A carries out when started-up by the application 32, and theprocessing which the workflow managing section 46A carries out each timea data request is inputted from the buffer module 40, are the same as atthe time when the form of execution of the image processing is blockunit processing. Accordingly, in the whole image processing as well,after a processing request is inputted from the workflow managingsection 46A to the image processing module 38 of the final stage of theimage processing section 50, as shown in (2) through (10) of FIG. 18,the input of a data request to the preceding buffer module 40 from theimage processing module 38 to which the processing request was inputted,and the input of a processing request to the preceding image processingmodule of the buffer module 40 from the workflow managing section 46Aaccompanying the input of a data request to the workflow managingsection 46A from that buffer module 40 to which the data request wasinputted, proceed successively from the image processing module 38 ofthe final stage of the image processing section 50 to the imageprocessing module 38 at the forward-most stage of the image processingsection 50.

Further, when a processing request is inputted from the workflowmanaging section 46A, the image processing module 38, of theforward-most stage of the image processing section 50 acquires imagedata of the unit reading data amount from the image data supplyingsection 22 (refer to (11) of FIG. 18). The image processing module 38,writes the image data, which is obtained by the image processing engine38A carrying out image processing on the acquired image data, to thebuffer 40A of the following buffer module 40 ₁ (refer to (12) of FIG.18), and inputs a processing completed notice to the workflow managingsection 46A. In a case in which the form of execution of imageprocessing is whole image processing, each time a processing completednotice is inputted from the image processing module 38, the workflowmanaging section 46A carries out the whole image control processing 3shown in FIG. 17C. In the whole image control processing 3, in step 546,the processing request is re-inputted to the image processing module 38which is the source of the processing completed notice, and processingends. In this way, in the whole image control processing, during theperiod of time until the specific image processing module 38, whichinputted the processing completed notice to the workflow managingsection 46A, completes image processing on the image-data which is theobject of processing, each time a processing completed notice isinputted from that specific image processing module 38, the processingrequest is repeatedly inputted only to that specific image processingmodule 38.

When the image processing module 38, completes image processing of theimage data which is the object of processing, and all of the image data,which is the object of processing and which has undergone imageprocessing at the image processing module 38 ₁, is stored in the buffer40A of the buffer module 40 ₁, an entire processing ended notice isinputted from the image processing module 38 ₁ to the workflow managingsection 46A. In a case in which the form of execution of the imageprocessing is whole image processing, each time an entire processingended notice is inputted from the image processing module 38, theworkflow managing section 46A carries out the whole image controlprocessing 4 shown in FIG. 17D. In this whole image control processing4, in step 548, it is judged whether or not the source of the entireprocessing ended notice is the image processing module 38 of the finalstage of the image processing section 50. If the judgment is negative,the routine moves on to step 550 where, on the basis of the informationregistered in the table shown in FIG. 4B, the image processing module38, which is next after the image processing module 38 which is thesource of the entire processing ended notice, is recognized, aprocessing request is inputted to this recognized next image processingmodule 38, and processing ends.

In this way, in the whole image control processing, a processing requestinputted to the image processing module 38 of the final stage istransferred backward to the further preceding image processing modules38, and after reaching the image processing module 38 of theforward-most stage, the processing request is repeatedly inputted onlyto the image processing module 38 of the forward-most stage. When imageprocessing at that image processing module 38 of all of the image datawhich is the object of processing is completed, image processing on allof the image data which is the object of processing is carried out atthe next image processing module 38. Due to this processing proceedingin order to the following image processing modules 38, the series ofimage processing operations is carried out. Then, when an entireprocessing ended notice is inputted from the image processing module 38of the final stage due to all of the image data, which is obtained bythe needed image processings being carried out on the image data whichis the object of processing, being outputted to the image outputtingsection 24, the judgment of step 548 of the whole image controlprocessing 4 (FIG. 17D) is affirmative, and the routine proceeds to step552. In step 552, the application 32 is notified of the completion ofimage processing (refer to step 180 of FIG. 3 as well), and the wholeimage control processing ends. Then, the application 32, which isinformed of the completion of image processing, notifies the user thatimage processing is completed (refer to step 182 of FIG. 3 as well).

In the whole image control processing shown in FIG. 17, the imageprocessing module 38, to which the processing request is repeatedlyinputted, is switched on the occasion of the inputting of the entireprocessing ended notice from the image processing module. However, thepresent invention is not limited to the same. A structure may be used inwhich the image processing module 38, to which the processing request isrepeatedly inputted, is switched on the occasion of the inputting of theprocessing ended notice from another image processing module 38.

Further, in the above description, the input of the processing requestto the image processing module 38 of the final stage is carried out bythe workflow managing section 46A. However, the present invention is notlimited to the same. The workflow managing section 46A may hold themodule, which is positioned at the final stage of a pipeline or atplural final points of a directed acyclic graph, and carry out theprocessing request, or the application 32 may hold these modules andcarry out the processing request. Or, as in the example ofabove-described FIG. 5B, in a case in which, at the interior of themodule generating section 44, an image processing module which carriesout skew angle sensing processing and an image processing module whichcarries out image rotating processing are combined so as to form a skewcorrecting processing module, the skew angle information is needed as aprocessing parameter at the time of generating the image rotatingprocessing module. Thus, at the interior of the skew correcting modulegenerating section, it is also possible to employ a method in which aprocessing request is repeatedly made to the skew angle sensingprocessing module, and the entire image is processed, and the skew angleinformation obtained as a result thereof is provided to the imagerotating processing module as a processing parameter.

Next, description will be given of the deleting of the image processingmodule 50, which is carried out after image processing on the image datawhich is the object of processing has been completed. In step 308 of theimage processing module control processing (FIG. 13), the controlsection 38B of the individual image processing module 38 outputs anentire processing ended notice to the workflow managing section 46A andto the following module, and thereafter, in step 310, carries outself-module deletion processing.

As shown in FIG. 14, in the self-module deletion processing, first, instep 320, the control section 38B requests the resource managing section46B to free the memory region reserved in previous step 254 (FIG. 12).In this way, due to the processing for a memory freeing request (FIG.2C) being carried out at the resource managing section 46B, this memoryregion is freed. In next step 322, it is judged whether or not there isa resource, other than the memory, which its own module reserved throughthe resource managing section 46B. If the judgment is negative, theroutine moves on to step 326, without any processing being carried out.If the judgment is affirmative, the routine moves on to step 324. Instep 324, the control section 38B notifies the resource managing section46B of the identification information of its own module, and requeststhe freeing of the resource, other than the memory, which its own modulereserved. In this way, due to the processing for a resource freeingrequest (FIG. 2E) being carried out at the resource managing section46B, this resource is freed.

In the self-module deletion processing (FIG. 14), the routine proceedsto step 326 if the judgment in step 322 is negative, or if, after theresource managing section 46B is requested to free a resource other thanthe memory in step 324, a notice that resource freeing is completed isgiven from the resource managing section 46B. In step 326, the controlsection 38B inputs a deletion notice, for giving notice that processingfor deleting its own module is to be carried out, to the precedingmodule of its own module, the following module of its own module, andthe workflow managing section 46A. Then, in step 328, the processing ofdeleting its own module is carried out, and the self-module deletingprocessing of FIG. 14 (i.e., step 310 of FIG. 13) ends. Note thatdeleting of its own module can be realized by either ending the processor thread corresponding to its own module, or deleting the object.

In the buffer control processing (FIG. 6) carried out by the buffercontrol section 40B of the buffer module 40, when a deletion notice isinputted from the image processing module 38 of the preceding or thefollowing stages of its own module, the judgment in step 380 isaffirmative, and the routine moves on to step 390. In step 390, afterthe module which is the source of input of the deletion notice isstored, it is judged whether or not deletion notices have been inputtedfrom all of the modules of the preceding and the following stages of itsown module. If the judgment is negative, the routine returns to step378, and steps 378 and 380 are repeated as described above as well.Further, when deletion notices are inputted from all of the modules ofthe preceding and the following stages of its own module, the judgmentin step 390 is affirmative, and the routine proceeds to step 392. Instep 392, due to a deletion notice being inputting to the workflowmanaging section 46A, notice is given that the processing of deletingits own module is to be carried out. Then, in next step 394, processingfor deleting its own module is carried out, and the buffer controlprocessing (FIG. 6) ends.

Finally, processing in a case in which an error arises while the imageprocessing section 50 is executing image processing will be described.When an error arises while the image processing section 50 is executingimage processing, the error managing section 46C of the processingmanaging section 46 carries out the error occurrence interruptionprocessing shown in FIG. 19 due to an interruption arising. In thiserror occurrence interruption processing, first, in step 570, errorinformation, such as the type of, the place of occurrence of, and thelike of the error which has arisen is acquired. In the presentembodiment, the storage 20 stores device environment information, whichexpresses the type and the structure and the like of the device in whichis incorporated the computer 10 in which the image processing programgroup 34 is implemented. In next step 572, this device environmentinformation is acquired from the storage 20 or the like, and an errornotification method, which corresponds to the device environmentexpressed by the acquired device environment information, is determined.

For example, if the computer 10 is an independent computer such as a PCor the like, a display at which various information can be displayed atone time is provided as the display 16. Therefore, an error notificationmethod, such as displaying all of the contents of the error informationacquired in step 570 on the display 16 by a pop-up window or the like,can be selected as the error notification method. Further, for example,if the device in which the computer 10 is incorporated is a device suchas a copier, a printer, a fax machine, a multifunction device, ascanner, a photographic printer, or the like, the amount of informationwhich can be displayed at one time on the display 16 is limited, but abuzzer or the like is provided. Thus, a notification method can beselected in which, by sounding the buzzer, notification is given that anerror has occurred, and, among the error information acquired in step570, only the type of the error is displayed on the display 16, or thelike. Then, in step 574, notification of occurrence of an error is givenby the error notification method determined in step 572, and the erroroccurrence interruption processing ends.

In this way, in the error occurrence interruption processing relating tothe present embodiment, an error notification method which correspondsto the device environment is selected from among plural types of errornotification methods, and notification that an error has arisen is givenby the selected error notification method. Therefore, the presentinvention can be applied by implementing the image processing programgroup 34 relating to the present invention in computers 10 of variousstructures, and the applicability improves. Further, there is no need tocarry out a setting changing operation, such as switching the processingat the time that an error arises or the like, in accordance with thestructure of the computer 10 in which the image processing program group34 is implemented (i.e., in accordance with whether it is an independentcomputer, or a computer implemented in any of various types of devices,or the like). Therefore, the burden of operation for implementation islessened.

Here, although error processing is explained on the premise ofinterruption processing, the error processing is not limited tointerruption processing. For example, the following structure may beused: when an error occurs, that module informs the error managingsection 46C of error information, and a state code, which expresses thatprocessing cannot be carried out with respect to the processinginstructions thereafter, is returned. The processing managing section46, which has received this information, returns this information to theapplication 32. The application 32 receives the error information fromthe error managing section 46C of the processing section 46, and on thebasis thereof, itself carries out processing such as display or a buzzeror the like.

Description is given above of an example in which, although a readingrequest is inputted to the buffer module 40 from the following imageprocessing module 38. In a case in which the data amount of theeffective data which can be read by the image processing module 38 whichis the source of the reading request, is less than the unit reading dataamount, and the end of the effective data which can be read is not theend of the image data to be the object of processing, a data request isrepeatedly inputted from the buffer module 40 to the workflow managingsection 46A until either the data amount of the effective data which canbe read is greater than or equal to the unit reading data amount, or itis sensed that the end of the effective data which can be read is theend of the image data which is the object of processing. However, thepresent invention is not limited to the same. In the above-describedcase, the buffer module 40 may input a data request to the workflowmanaging section 46A only one time, and may input an accumulationcompleted notice to the workflow managing section 46A either when thedata amount of the effective data which can be read becomes greater thanor equal to the unit reading data amount, or when it is sensed that theend of the effective data which can be read is the end of the image datawhich is the object of processing. Then, during the period of time fromafter the data request has been inputted from the buffer module 40 untilthe accumulation completed notice is inputted, the workflow managingsection 46A may repeatedly input a processing request to the precedingimage processing module 38 of that buffer module 40.

Further, the above describes, as an example, an embodiment in which in acase in which a reading request is inputted from the following imageprocessing module 38 and the effective data, which can be read by theimage processing module 38 which is the source of the reading request,is not stored in the buffer 40A of its own module, the buffer controlsection 40B inputs a data request to the workflow managing section 46A.However, the present invention is not limited to the same, and in theabove-described case, the buffer control section 40B may directly inputa data request to the preceding image processing module 38. In thisembodiment, the processing sequence in a case in which the form ofexecution of the image processing is block unit processing is shown inFIG. 20. As is clear from FIG. 20 as well, in this embodiment, itsuffices for the workflow managing section 46A to input a processingrequest only to the image processing module 38 of the final stage in theimage processing section 50, and therefore, the processing at theworkflow managing section 46A is simple.

Further, as an example of image processing of a block unit, anembodiment is described above in which, first, the workflow managingsection 46A inputs a processing request to the image processing module38 of the final stage, and that processing request is successivelytransferred to preceding modules as a data request or a processingrequest. However, the present invention is not limited to the same. Itis also possible to successively transfer the processing request or datarequest from the preceding modules to the following modules, and carryout image processing in block units. This can be realized as follows forexample. The buffer control section 40B of the buffer module 40 isstructured such that, each time image data is written to the buffer 40Aby the preceding image processing module 38 of its own module, if thedata amount of the effective data which can be read by the followingimage processing module 38 is less than the unit reading data amount andthe end of the effective data which can be read is not the end of theimage data which is the object of processing, the buffer control section40B inputs the data request to the workflow managing section 46A. On theother hand, the buffer control section 40B inputs the accumulationcompleted notice to the workflow managing section 46A either when thedata amount of the effective data which can be read becomes greater thanor equal to the unit reading data amount, or when it is sensed that theend of the effective data which can be read is the end of the image datawhich is the object of processing. Moreover, the workflow managingsection 46A is structured such that, after inputting a processingrequest to the image processing module 38 of the final stage of theimage processing section 50, each time a data request is inputted froman arbitrary buffer module 40, the workflow managing section 46A inputsa processing request to the preceding image processing module 38 of thebuffer module 40 which is the source of the data request. Each time anaccumulation completed notice is inputted from an arbitrary buffermodule 40, the workflow managing section 46A inputs a processing requestto the following image processing module 38 of that buffer module 40.Further, in the above, it is possible for the data request from thebuffer module 40 to be directly inputted as a processing request to thepreceding image processing module 38 of that buffer module 40, and forthe accumulation completion notice from the buffer module 40 to bedirectly inputted as a processing request to the following imageprocessing module 38 of that buffer module 40.

Moreover, the above describes an embodiment in which, for the buffermodule 40, the unit writing data amount is set in advance from thepreceding image processing module 38, and the unit reading data amountis set in advance from the following image processing module. However,the present invention is not limited to the same. The data amount ofwriting or reading may be notified from the image processing module 38each time of writing data to the buffer module 40 or reading data fromthe buffer module 40.

In the above configuration, each time a writing request or a readingrequest is inputted to the buffer module 40, the inputted request isregistered in a queue as request information, and the requestinformation is taken-out one-by-one from the queue and processed. Inthis way, exclusive control is realized in which, at the time of inputof a writing request, if reading of data from the buffer 40A is beingexecuted, after that data reading is completed, data writing processingcorresponding to that writing request is carried out, and, at the timeof input of a reading request, if writing of data to the buffer 40A isbeing executed, after that data writing is completed, data readingprocessing corresponding to that reading request is carried out.However, the present invention is not limited to the same. For example,exclusive control which uses a unit buffer region as a unit may becarried out. Namely, at the time of input of a writing request, ifreading of data is being executed with respect to a unit buffer regionof an object of writing in that writing request within the buffer 40A,after that data reading is completed, data writing processingcorresponding to that writing request is carried out. Further, at thetime of input of a reading request, if writing of data is being executedwith respect to a unit buffer region of an object of reading in thatreading request within the buffer 40A, after that data writing iscompleted, data reading processing corresponding to that reading requestis carried out. Exclusive control which uses a unit buffer region as aunit can be realized by, for example, providing a queue at eachindividual unit buffer region and carrying out exclusive control, or thelike.

Further, the above describes an example in which, among the individualimage processing modules 38 whose programs are registered in the modulelibrary 36, programs, which correspond to the control sections 38B ofthe image processing modules 38 whose unit reading data amounts and unitwriting data amounts are the same, are used in common. However, thepresent invention is not limited to the same. For example, the programcorresponding to the control section 38B may be divided into a programwhich corresponds to a first control section which acquires image datafrom the preceding module and inputs it to the image processing engine38A, a program which corresponds to a second control section whichoutputs to the preceding module data which is outputted from the imageprocessing engine 38A, and a program which corresponds to a commoncontrol section which carries out control (e.g., communication with theworkflow managing section 46A, or the like) which does not depend on theunit reading data amount, the unit processing data amount, or the unitwriting data amount. At all of the image processing modules, the programcorresponding to the common control section can be used in common. Theprogram corresponding to the first control section can be used in commonat image processing modules 38 whose unit reading data amounts are thesame. The program corresponding to the second control section can beused in common at image processing modules 38 whose unit writing dataamounts are the same.

Because the instance of the individual modules which structure the imageprocessing section 50 are programs, the image processings by the imageprocessing section 50 are realized by the CPU 12 in actuality. Here, thefollowing system (so-called round robin system) may be used: theprograms corresponding to the individual image processing modules 38structuring the image processing section 50 are registered in a queue asprocesses, threads, or objects which are objects of execution by the CPU12. Each time a program, which is registered in that queue and whichcorresponds to a specific image processing module, is taken-out fromthat queue by the CPU 12, it is judged whether or not image data of theunit processing data amount can be acquired from the preceding module ofthe specific image processing module 38. Only in cases in which isjudged that the image data of the unit processing data amount can beacquired, the image data of the unit processing data amount is acquiredfrom the preceding module of that specific image processing module 38.Predetermined image processing (processing corresponding to the imageprocessing engine 38A of the specific image processing module 38) iscarried out on the acquired image data of the unit processing dataamount. Processing is carried out which outputs, to the following moduleof its own module, the image data which has undergone the predeterminedimage processing, or the processing results of the predetermined imageprocessing. Thereafter, if processing on the entire image which is theobject of processing is not finished, the taken-out programcorresponding to the specific image processing module is re-registeredin that queue as a process, thread, or object of the object ofexecution. Due to the CPU 12 repeating these unit image processings, theentire image which is the object of processing is processed by the imageprocessing section 50.

1. An image processing device comprising: an image processing section,the image processing section having: (A) one or more image processingmodules, each image processing module having: (1) an image processingengine carrying out a predetermined image processing on image data inunits of a unit processing data amount which is set in advance, and (2)a control section inputting image data, which is acquired from apreceding stage of its own module, in data amount units needed in orderfor the image processing engine to carry out processing in units of theunit processing data amount, and outputting, to a following stage of itsown module, image data, which has undergone a predetermined imageprocessing by the image processing engine, or processing results of thepredetermined image processing, the one or more image processing modulesbeing selected from a plurality of types of image processing modules atwhich types or contents of image processings carried out by the imageprocessing engines are different from one another; and (B) one or morebuffer modules having a buffer for storing image data, the imageprocessing section being constructed by individual modules beingconnected in a pipeline form or a directed acyclic graph form, such thatthe buffer module is connected at at least one of a preceding stage anda following stage of each image processing module which is selected,wherein the control section of the image processing module, in a case inwhich the buffer module is connected at a following stage of its ownmodule, carries out processing of writing, in units of a write dataamount which is set in advance at the following buffer module, imagedata, which is obtained by the image processing engine carrying out thepredetermined image processing on inputted image data, to the buffer ofthe following buffer module, and the image processing module is realizedby a program, which corresponds to the image processing engine, and aprogram, which corresponds to the control section, being executed by aCPU of the image processing device, and a portion of or an entirety ofthe program corresponding to the control section is used in common for,among the plurality of types of image processing modules, imageprocessing modules whose units of writing image data to the buffer ofthe buffer module connected at the following stage of its own module arethe same.
 2. An image processing device comprising: an image processingsection, the image processing section having: (A) one or more imageprocessing modules, each image processing module having: (1) an imageprocessing engine carrying out a predetermined image processing on imagedata in units of a unit processing data amount which is set in advance,and (2) a control section inputting image data, which is acquired from apreceding stage of its own module, in data amount units needed in orderfor the image processing engine to carry out processing in units of theunit processing data amount, and outputting, to a following stage of itsown module, image data, which has undergone a predetermined imageprocessing by the image processing engine, or processing results of thepredetermined image processing, the one or more image processing modulesbeing selected from a plurality of types of image processing modules atwhich types or contents of image processings carried out by the imageprocessing engines are different from one another; and (B) one or morebuffer modules having a buffer for storing image data, the imageprocessing section being constructed by individual modules beingconnected in a pipeline form or a directed acyclic graph form, such thatthe buffer module is connected at at least one of a preceding stage anda following stage of each image processing module which is selected,wherein the control section of the image processing module, in a case inwhich the buffer module is connected at a preceding stage of its ownmodule, carries out processings of reading, in units of a read dataamount which is set in advance at the preceding buffer module, imagedata which is stored in the buffer of the preceding buffer module, andinputting the read image data to the image processing engine as imagedata of the unit processing data amount, and the image processing moduleis realized by a program, which corresponds to the image processingengine, and a program, which corresponds to the control section, beingexecuted by a CPU of the image processing device, and a portion of or anentirety of the program corresponding to the control section is used incommon for, among the plurality of types of image processing modules,image processing modules whose units of reading image data from thebuffer of the buffer module connected at the preceding stage of its ownmodule are the same.
 3. The image processing device of claim 1, whereinthe unit processing data amount is set in advance in accordance with anoperational environment or a type of the predetermined image processingwhich the image processing engine carries out.
 4. The image processingdevice of claim 2, wherein the unit processing data amount is set inadvance in accordance with an operational environment or a type of thepredetermined image processing which the image processing engine carriesout.
 5. The image processing device of claim 1, wherein the imageprocessing modules, whose units of writing image data or units ofreading image data are the same, are image processing modules whosewrite data amounts or read data amounts are the same.
 6. The imageprocessing device of claim 2, wherein the image processing modules,whose units of writing image data or units of reading image data are thesame, are image processing modules whose write data amounts or read dataamounts are the same.
 7. The image processing device of claim 1, whereinthe image processing modules, whose units of writing image data or unitsof reading image data are the same, are image processing modules whichare determined by a same arithmetic operation formula on the basis ofprocessing parameters and attributes of image data which is an object ofprocessing.
 8. The image processing device of claim 2, wherein the imageprocessing modules, whose units of writing image data or units ofreading image data are the same, are image processing modules which aredetermined by a same arithmetic operation formula on the basis ofprocessing parameters and attributes of image data which is an object ofprocessing.
 9. The image processing device of claim 1, furthercomprising a processing managing section which causes the imageprocessing section to process an entire image which is an object ofprocessing by, at each image processing module of the image processingsection, causing repeating of a unit processing of inputting image dataacquired from a preceding stage of its own module to the imageprocessing engine and outputting, to a following stage of its ownmodule, image data which has undergone a predetermined image processingby the image processing engine or processing results of thepredetermined image processing.
 10. The image processing device of claim2, further comprising a processing managing section which causes theimage processing section to process an entire image which is an objectof processing by, at each image processing module of the imageprocessing section, causing repeating of a unit processing of inputtingimage data acquired from a preceding stage of its own module to theimage processing engine and outputting, to a following stage of its ownmodule, image data which has undergone a predetermined image processingby the image processing engine or processing results of thepredetermined image processing.
 11. The image processing device of claim9, wherein, in a case in which execution of whole image processing isinstructed, the processing managing section carries out, in order froman upstream-most image processing module of the image processingsection, causing a specific image processing module to repeat the unitprocessing until image data corresponding to the entire image which isthe object of processing is outputted from the specific image processingmodule.
 12. The image processing device of claim 10, wherein, in a casein which execution of whole image processing is instructed, theprocessing managing section carries out, in order from an upstream-mostimage processing module of the image processing section, causing aspecific image processing module to repeat the unit processing untilimage data corresponding to the entire image which is the object ofprocessing is outputted from the specific image processing module. 13.The image processing device of claim 1, further comprising aconstructing section which constructs the image processing section onthe basis of attributes of an image which is an object of processing andprocessing parameters which designate a type of image processing to beexecuted.
 14. The image processing device of claim 2, further comprisinga constructing section which constructs the image processing section onthe basis of attributes of an image which is an object of processing andprocessing parameters which designate a type of image processing to beexecuted.
 15. An image processing method carrying out image processingby an image processing device having an image processing section, theimage processing section having: (A) one or more image processingmodules, each image processing module having: (1) an image processingengine carrying out a predetermined image processing on image data inunits of a unit processing data amount which is set in advance, and (2)a control section inputting image data, which is acquired from apreceding stage of its own module, in data amount units needed in orderfor the image processing engine to carry out processing in units of theunit processing data amount, and outputting, to a following stage of itsown module, image data, which has undergone a predetermined imageprocessing by the image processing engine, or processing results of thepredetermined image processing, the one or more image processing modulesbeing selected from a plurality of types of image processing modules atwhich types or contents of image processings carried out by the imageprocessing engines are different from one another; and (B) one or morebuffer modules having a buffer for storing image data, the imageprocessing section being constructed by individual modules beingconnected in a pipeline form or a directed acyclic graph form, such thatthe buffer module is connected at at least one of a preceding stage anda following stage of each image processing module which is selected, themethod comprising the steps of: causing the control section of the imageprocessing module to, in a case in which the buffer module is connectedat a following stage of its own module, carry out processing of writing,in units of a write data amount which is set in advance at the followingbuffer module, image data, which is obtained by the image processingengine carrying out the predetermined image processing on inputted imagedata, to the buffer of the following buffer module; and utilizing incommon a portion of or an entirety of a program corresponding to thecontrol section at, among the plurality of types of image processingmodules, image processing modules whose units of writing image data tothe buffer of the buffer module connected at the following stage of itsown module are the same.
 16. An image processing method carrying outimage processing by an image processing device having an imageprocessing section, the image processing section having: (A) one or moreimage processing modules, each image processing module having: (1) animage processing engine carrying out a predetermined image processing onimage data in units of a unit processing data amount which is set inadvance, and (2) a control section inputting image data, which isacquired from a preceding stage of its own module, in data amount unitsneeded in order for the image processing engine to carry out processingin units of the unit processing data amount, and outputting, to afollowing stage of its own module, image data, which has undergone apredetermined image processing by the image processing engine, orprocessing results of the predetermined image processing, the one ormore image processing modules being selected from a plurality of typesof image processing modules at which types or contents of imageprocessings carried out by the image processing engines are differentfrom one another; and (B) one or more buffer modules having a buffer forstoring image data, the image processing section being constructed byindividual modules being connected in a pipeline form or a directedacyclic graph form, such that the buffer module is connected at at leastone of a preceding stage and a following stage of each image processingmodule which is selected, the method comprising the steps of: causingthe control section of the image processing module to, in a case inwhich the buffer module is connected at a preceding stage of its ownmodule, carry out processings of reading, in units of a read data amountwhich is set in advance at the preceding buffer module, image data,which is stored in the buffer of the preceding buffer module, andinputting the read image data to the image processing engine as imagedata of the unit processing data amount; and among the plurality oftypes of image processing modules which are realized by programs, whichcorrespond to the image processing engines, and programs, whichcorrespond to the control sections, being executed by a CPU of the imageprocessing device, utilizing in common a portion of or an entirety of aprogram corresponding to the control section at image processing moduleswhose units of reading image data from the buffer of the buffer moduleconnected at the preceding stage of its own module are the same.
 17. Acomputer-readable storage medium storing an image processing program formaking a computer function as an image processing device having an imageprocessing section, the image processing section having: (A) one or moreimage processing modules, each image processing module having: (1) animage processing engine carrying out a predetermined image processing onimage data in units of a unit processing data amount which is set inadvance, and (2) a control section inputting image data, which isacquired from a preceding stage of its own module, in data amount unitsneeded in order for the image processing engine to carry out processingin units of the unit processing data amount, and outputting, to afollowing stage of its own module, image data, which has undergone apredetermined image processing by the image processing engine, orprocessing results of the predetermined image processing, the one ormore image processing modules being selected from a plurality of typesof image processing modules at which types or contents of imageprocessings carried out by the image processing engines are differentfrom one another; and (B) one or more buffer modules having a buffer forstoring image data, the image processing section being constructed byindividual modules being connected in a pipeline form or a directedacyclic graph form, such that the buffer module is connected at at leastone of a preceding stage and a following stage of each image processingmodule which is selected, wherein the control section of the imageprocessing module, in a case in which the buffer module is connected ata following stage of its own module, carries out processing of writing,in units of a write data amount which is set in advance at the followingbuffer module, image data, which is obtained by the image processingengine carrying out the predetermined image processing on inputted imagedata, to the buffer of the following buffer module, and a portion of oran entirety of a program corresponding to the control section is used incommon for, among the plurality of types of image processing modules,image processing modules whose units of writing image data to the bufferof the buffer module connected at the following stage of its own moduleare the same.
 18. A computer-readable storage medium storing an imageprocessing program for making a computer function as an image processingdevice having an image processing section, the image processing sectionhaving: (A) one or more image processing modules, each image processingmodule having: (1) an image processing engine carrying out apredetermined image processing on image data in units of a unitprocessing data amount which is set in advance, and (2) a controlsection inputting image data, which is acquired from a preceding stageof its own module, in data amount units needed in order for the imageprocessing engine to carry out processing in units of the unitprocessing data amount, and outputting, to a following stage of its ownmodule, image data, which has undergone a predetermined image processingby the image processing engine, or processing results of thepredetermined image processing, the one or more image processing modulesbeing selected from a plurality of types of image processing modules atwhich types or contents of image processings carried out by the imageprocessing engines are different from one another; and (B) one or morebuffer modules having a buffer for storing image data, the imageprocessing section being constructed by individual modules beingconnected in a pipeline form or a directed acyclic graph form, such thatthe buffer module is connected at at least one of a preceding stage anda following stage of each image processing module which is selected,wherein the control section of the image processing module, in a case inwhich the buffer module is connected at a preceding stage of its ownmodule, carries out processings of reading, in units of a read dataamount which is set in advance at the preceding buffer module, imagedata which is stored in the buffer of the preceding buffer module, andinputting the read image data to the image processing engine as imagedata of the unit processing data amount, and among the plurality oftypes of image processing modules which are realized by programs, whichcorrespond to the image processing engines, and programs, whichcorrespond to the control sections, being executed by a CPU of the imageprocessing device, a portion of or an entirety of a programcorresponding to the control section is used in common at imageprocessing modules whose units of reading image data from the buffer ofthe buffer module connected at the preceding stage of its own module arethe same.